Paper Abstract and Keywords |
Presentation |
2015-07-13 16:00
[Invited Talk]
Reformulation of Information Theory by New Information Measures Tomohiko Uyematsu (Tokyo Tech) IT2015-27 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
Han and Verd'u introduced a new information measure called as
information spectrum, and developed the most general information theory
in terms of the information spectrum. Later,
Renner and Wolf introduced another new information
measure called as smooth entropy,
and reformulated the source coding problem.
Since then, some research groups have developed
methods to deal with general
sources and channels by using the smooth entropy
or the smooth R'enyi divergence instead of the information spectrum.
This paper surveys some researches which reformulate various
problems in information theory in terms of the smooth entropy
or the smooth R'enyi divergence.
We also clarify why these information measures
are essential in the study
of general sources and channels. Specifically, the smooth max-entropy and the smooth
min-entropy have clear operational meanings in the fixed-length source
coding problem and the intrinsic randomness problem, respectively.
Further, the smooth min R'enyi divergence and the smooth max R'enyi
divergence have their operational meanings in the channel coding
problem and the rate-distortion theory, respectively.
We also demonstrate that the converse coding theorems can be easily
derived by using these information measures. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
smooth entropy / smooth Renyi divergence / source coding theorem / channel coding theorem / rate-distortion theory / random number generation / / |
Reference Info. |
IEICE Tech. Rep., vol. 115, no. 137, IT2015-27, pp. 59-66, July 2015. |
Paper # |
IT2015-27 |
Date of Issue |
2015-07-06 (IT) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
IT2015-27 |
Conference Information |
Committee |
IT |
Conference Date |
2015-07-13 - 2015-07-14 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Tokyo Institute of Technology |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
freshman session, general |
Paper Information |
Registration To |
IT |
Conference Code |
2015-07-IT |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Reformulation of Information Theory by New Information Measures |
Sub Title (in English) |
|
Keyword(1) |
smooth entropy |
Keyword(2) |
smooth Renyi divergence |
Keyword(3) |
source coding theorem |
Keyword(4) |
channel coding theorem |
Keyword(5) |
rate-distortion theory |
Keyword(6) |
random number generation |
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Tomohiko Uyematsu |
1st Author's Affiliation |
Tokyo Institute of Technology (Tokyo Tech) |
2nd Author's Name |
|
2nd Author's Affiliation |
() |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2015-07-13 16:00:00 |
Presentation Time |
50 minutes |
Registration for |
IT |
Paper # |
IT2015-27 |
Volume (vol) |
vol.115 |
Number (no) |
no.137 |
Page |
pp.59-66 |
#Pages |
8 |
Date of Issue |
2015-07-06 (IT) |
|