Нашли опечатку? Выделите ее мышкой и нажмите Ctrl+Enter
Название: A comparison of the Shannon and Kullback information measures
Авторы: Hobson Arthur, Cheng Bin-Kang
Аннотация:
Two widely used information measures are compared. It is shown that the Kullback measure, unlike the Shannon measure, provides the basis for a consistent theory of information which extends to continuous sample spaces and to nonconstant prior distributions. It is shown that the Kullback measure is a generalization of the Shannon measure, and that the Kullback measure has more reasonable additivity properties than does the Shannon measure. The results lend support to Jaynes's entropy maximization procedure.