Towards a Theory of Semantic Communication (Extended Technical Report)

reportActive / Technical Report | Accession Number: ADA544137 | Open PDF

Abstract:

This paper studies methods of quantitatively measuring semantic information in communication. We review existing work on quantifying semantic information, then investigate a model-theoretical approach for semantic data compression and reliable semantic communication. We relate our approach to the statistical measurement of information by Shannon, and show that Shannons source and channel coding theorems have semantic counterparts.

Author(s):
Bao, Jie ; Basu, Prithwish ; Dean, Mike ; Partridge, Craig ; Swami, Ananthram ; Leland, Will ; Hendler, James A.
Author Organization(s):
RENSSELAER POLYTECHNIC INST TROY NY
Descriptive Note:
Technical rept.
Supplementary Note:
Prepared in collaboration with US Army Research Lab, Adelphi, MD. A shorter version of this report has been published in the 2011 IEEE First International Workshop on Network Science, West Point, NY on 22-24 Jun 2011. The original document contains color images. DOI: 10.21236/ADA544137
Pagination:
0014

Security Markings

DOCUMENT & CONTEXTUAL SUMMARY

Distribution:
Approved For Public Release
Distribution Statement:
Approved For Public Release; Distribution Is Unlimited.

RECORD

Collection: TR
Identifying Numbers
Contract/Grant Number(s):
W911NF-09-C-0053
Monitor Series:
ARL
 Subject Terms
Joint Capability Areas:
JCA_5_Command and Control; JCA_6_Net Centric; JCA_6.1_Information Transport; JCA_5.2.2_Develop Knowledge and Situational Awareness; JCA_5.2_Understand; JCA_5.3_Planning; JCA_1_Force Support; JCA_8_Building Partnerships; JCA_4.6_Engineering; JCA_1.3_Human Capital Management; JCA_8.1.1_Inform Domestic and Foreign Audiences; JCA_8.1_Communicate; JCA_1.2_Force Preparation; JCA_1.3.1_Personnel and Family Support; JCA_8.2_Shape; JCA_1.2.6_Concepts; JCA_1.2.5_Lessons Learned; JCA_6.4.1_Secure Information Exchange
Modernization Areas:
AI and Machine Learning
Communities of Interest:
Materials and Manufacturing Processes
Descriptor(s):
*INFORMATION THEORY, SEMANTICS, THEOREMS, NATURAL LANGUAGE, MATHEMATICAL MODELS
Field(s)/Group(s):
Information Science, Linguistics
Keyword(s):
SHANNON INFORMATION THEORY, SEMANTIC COMMUNICATIONS, COMMUNICATION MODELS, CHANNEL CODING
Report Date:
2011 Mar 01
Creation Date:
2011 Jul 06