Information theory - the big idea
IELTS Academic Reading Passage![](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
Information theory lies at the heart of everything – from DVD players and the genetic code of DNA to the physics of the universe at its most fundamental. It has been central to the development of the science of communication, which enables data to be sent electronically and has therefore had a major impact on our lives
A
In April 2002 an event took place which demonstrated one of the many applications of information theory. The space probe, Voyager I, launched in 1977, had sent back spectacular images of Jupiter and Saturn and then soared out of the Solar System on a one-way mission to the stars. After 25 years of exposure to the freezing temperatures of deep space, the probe was beginning to show its age. Sensors and circuits were on the brink of failing and NASA experts realised that they had to do something or lose contact with their probe forever. The solution was to get a message to Voyager I to instruct it to use spares to change the failing parts. With the probe 12 billion kilometres from Earth, this was not an easy task. By means of a radio dish belonging to NASA’s Deep Space Network, the message was sent out into the depths of space. Even travelling at the speed of light, it took over 11 hours to reach its target, far beyond the orbit of Pluto. Yet, incredibly, the little probe managed to hear the faint call from its home planet, and successfully made the switchover.
B
It was the longest-distance repair job in history, and a triumph for the NASA engineers. But it also highlighted the astonishing power of the techniques developed by American communications engineer Claude Shannon, who had died just a year earlier. Born in 1916 in Petoskey, Michigan, Shannon showed an early talent for maths and for building gadgets, and made breakthroughs in the foundations of computer technology when still a student. While at Bell Laboratories, Shannon developed information theory, but shunned the resulting acclaim. In the 1940s, he single-handedly created an entire science of communication which has since inveigled its way into a host of applications, from DVDs to satellite communications to bar codes – any area, in short, where data has to be conveyed rapidly yet accurately.
C
This all seems light years away from the down-to-earth uses Shannon originally had for his work, which began when he was a 22-year-old graduate engineering student at the prestigious Massachusetts Institute of Technology in 1939. He set out with an apparently simple aim: to pin down the precise meaning of the concept of ‘information’. The most basic form of information, Shannon argued, is whether something is true or false – which can be captured in the binary unit, or ‘bit’, of the form 1 or 0. Having identified this fundamental unit, Shannon set about defining otherwise vague ideas about information and how to transmit it from place to place. In the process he discovered something surprising: it is always possible to guarantee information will get through random interference – ‘noise’ – intact.
D
Noise usually means unwanted sounds which interfere with genuine information. Information theory generalises this idea via theorems that capture the effects of noise with mathematical precision. In particular, Shannon showed that noise sets a limit on the rate at which information can pass along communication channels while remaining error-free. This rate depends on the relative strengths of the signal and noise travelling down the communication channel, and on its capacity (its ‘bandwidth’). The resulting limit, given in units of bits per second, is the absolute maximum rate of error-free communication given signal strength and noise level. The trick, Shannon showed, is to find ways of packaging up – ‘coding’ – information to cope with the ravages of noise, while staying within the information-carrying capacity – ‘bandwidth’ – of the communication system being used.
E
Over the years scientists have devised many such coding methods, and they have proved crucial in many technological feats. The Voyager spacecraft transmitted data using codes which added one extra bit for every single bit of information; the result was an error rate of just one bit in 10,000 – and stunningly clear pictures of the planets. Other codes have become part of everyday life – such as the Universal Product Code, or bar code, which uses a simple error-detecting system that ensures supermarket check-out lasers can read the price even on, say, a crumpled bag of crisps. As recently as 1993, engineers made a major breakthrough by discovering so-called turbo codes – which come very close to Shannon’s ultimate limit for the maximum rate that data can be transmitted reliably, and now play a key role in the mobile videophone revolution.
F
Shannon also laid the foundations of more efficient ways of storing information, by stripping out superfluous (‘redundant’) bits from data which contributed little real information. As mobile phone text messages like ‘I CN C U’ show, it is often possible to leave out a lot of data without losing much meaning. As with error correction, however, there’s a limit beyond which messages become too ambiguous. Shannon showed how to calculate this limit, opening the way to the design of compression methods that cram maximum information into the minimum space.
Questions 1-6
Reading Passage has six paragraphs, A-F.
Which paragraph contains the following information?
Write the correct letter, A-F, in boxes 1-6 on your answer sheet.
- an explanation of the factors affecting the transmission of information
- an example of how unnecessary information can be omitted
- a reference to Shannon’s attitude to fame
- details of a machine capable of interpreting incomplete information
- a detailed account of an incident involving information theory
- a reference to what Shannon initially intended to achieve in his research
Questions 7-11
Complete the notes below.
Choose NO MORE THAN THREE WORDS from the passage for each answer. Write your answers in boxes 7-11 on your answer sheet.
The Voyager 1 Space Probe
- The probe transmitted pictures of both 7…………………, then left the 8…………………
- The freezing temperatures were found to have a negative effect on parts of the space probe.
- Scientists feared that both the 9……………… were about to stop working.
- The only hope was to tell the probe to replace them with 10…………………….... – but distance made communication with the probe difficult.
- A 11………………………….. was used to transmit the message at the speed of light.
- The message was picked up by the probe and the switchover took place.
Questions 12-14
Do the following statements agree with the information given in Reading Passage?
In boxes 12-14 on your answer sheet, write
TRUE if the statement agrees with the information
FALSE if the statement contradicts the information
NOT GIVEN if there is no information on this
12. The concept of describing something as true or false was the starting point for Shannon in his attempts to send messages over distances.
13. The amount of information that can be sent in a given time period is determined with reference to the signal strength and noise level.
14. Products have now been developed which can convey more information than Shannon had anticipated as possible.
Check Your Answers After Doing Test
Questions Set 1 Answers
Solution for: Information theory – the big idea
Answer Table
1. D | 8. Solar System |
2. F | 9. sensors and circuits IN EITHER ORDER; BOTH REQUIRED FOR ONE MARK |
3. B | 10. spares |
4. E | 11. radio dish |
5. A | 12. TRUE |
6. C | 13. TRUE |
7. Jupiter and Saturn IN EITHER ORDER; BOTH REQUIRED FOR ONE MARK | 14. FALSE |
Resources:
Do you want to learn more about Otter?
Academic Reading Passages
![History of timekeeping](https://www.ieltsvisa.com/wp-content/uploads/2024/06/History-of-timekeeping.png)
History of timekeeping
Ever since man first noticed the regular movement of the Sun and the stars, we have wondered about the passage of time. Prehistoric people first recorded the phases of the Moon some 30,000 years ago, and recording time has been a way by which humanity has observed the...
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
Human remain in Green Sahara
{A} On October 13,2,000, a small team of paleontologists led by Paul Sereno of the University of Chicago clambered out of three battered Land Rovers, filled their water bottles, and scattered on foot across the toffee-colored sands of the Tenere desert in northern...
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
How war debris could cause cancer
A Could the mystery over how depleted uranium might cause genetic damage be closer to being solved? It may be, if a controversial claim by two researchers is right. They say that minute quantities of the material lodged in the body may kick out energetic electrons...
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
How much higher? How much faster?
How much higher? How much faster? — Limits to human sporting performance are not yet in sight — Since the early years of the twentieth century, when the International Athletic Federation began keeping records, there has been a steady improvement in how fast athletes...
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
![Human remain in Green Sahara](https://www.ieltsvisa.com/wp-content/uploads/2023/08/student_reading_test-scaled.jpeg)
How should reading be taught?
By Keith Rayncr a Barbara R Foorman A Learning to speak is automatic for almost all children, but learning to read requires elaborate instruction and conscious effort. Well aware of the difficulties, educators have given a great deal of thought to how they can best...
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
IELTS Academic Reading – Band Score Description and Calculation
IELTS Academic Reading - Band Score Description and Calculation The IELTS Academic Reading test is graded on a band scale of 0 to 9, with 9 being the highest score possible. Each band score corresponds to a level of proficiency in English. The following is a general...
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
IELTS Academic Reading FAQs
IELTS Academic Reading FAQs What types of texts will I encounter on the IELTS Reading test? You may encounter a range of text types, including academic articles, reports, newspaper articles, and advertisements. The texts will cover a range of topics, from science and...
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
![IELTS Academic Reading – Band Score Description and Calculation](https://www.ieltsvisa.com/wp-content/uploads/2020/06/music-sound-communication-audio-2235-scaled-1.jpg)
IELTS Reading – Improve Vocabulary and Grammar Skills
IELTS Reading - Improve Vocabulary and Grammar Skills To improve your vocabulary and grammar skills for the IELTS Reading test, here are some tips: Read extensively: Reading extensively is one of the best ways to improve your vocabulary and grammar skills. Read a...