Question
Download Solution PDFA source produces 4 symbols with probabilities 1/2, 1/4, 1/8 and 1/8. For this source, a practical coding scheme has an average code word length of 2 bits / symbol. The efficiency of the code is:
Answer (Detailed Solution Below)
Detailed Solution
Download Solution PDFConcept:
Information associated with the event is “inversely” proportional to the probability of occurrence.
Entropy: The average amount of information is called the “Entropy”.
Efficiency is given as:
Where,
L: Average code word Length
Calculation:
4 symbols and their
probabilities are 1/2, 1/4, 1/8, 1/8
H =
H = 7/4 bits/symbol
Last updated on Jul 2, 2025
-> ESE Mains 2025 exam date has been released. As per the schedule, UPSC IES Mains exam 2025 will be conducted on August 10.
-> UPSC ESE result 2025 has been released. Candidates can download the ESE prelims result PDF from here.
-> UPSC ESE admit card 2025 for the prelims exam has been released.
-> The UPSC IES Prelims 2025 will be held on 8th June 2025.
-> The selection process includes a Prelims and a Mains Examination, followed by a Personality Test/Interview.
-> Candidates should attempt the UPSC IES mock tests to increase their efficiency. The UPSC IES previous year papers can be downloaded here.