Deep Learning Enabled Semantic Communications

1. Auflage 2025
ISBN: 978-1-394-30623-7
Verlag: Wiley

Buch, Englisch, 176 Seiten

Comprehensive overview of the principles, theories, and techniques behind deep learning-enabled semantic communications

Deep Learning Enabled Semantic Communications explores the synergy between deep learning and semantic communication, particularly in the context of advancing 6G networks. It provides a focused introduction to the subject, systematically covering deep learning-enabled semantic communication systems and task-oriented semantic transmission paradigms in wireless communication.

The book reviews various aspects of semantic communications, including information theory, multimodal technologies, semantic noise, and semantic sensing. It explores cutting-edge semantic communication architectures, highlighting their advantages over traditional approaches and their potential to drive the future of intelligent information industry. The book also details applications of deep learning-based semantic communication systems across various sources, including text, speech, images, and videos, comprehensively addressing system design, performance optimization, and measurement metrics.

The book is divided into eight main parts, which cover foundational knowledge, system design, multimodal and multitask-oriented semantic communication systems, joint semantic sensing and sampling, semantic noise suppression, and generative AI enabled systems.

Written by a diverse group of experts in academia and research institutions, Deep Learning Enabled Semantic Communications includes information on: - Fundamental knowledge about the deep learning and semantic communications, including the history, neural networks, and semantic information theory
- Compression of multimodal inputs, extraction of global semantic information, and the design of neural networks to boost the capability of handling lengthy speech
- Incorporation of different sources to extract semantic features and serve diverse intelligent tasks at the receiver
- Introduction of semantic impairments in communications to uncover how to design robust systems
- Joint design of data sampling, compression, and coding schemes under the guidance of semantic information
- Framework of generative semantic communications to detail the principles of incorporating generative models into semantic communications

Deep Learning Enabled Semantic Communications is an essential learning resource and reference for graduate and undergraduate students pursuing degrees in wireless communications, signal processing, or deep learning as well as engineers in the telecommunications and IT industries focusing on wireless communication techniques.

Autoren/Hrsg.

Qin, Zhijin

Tao, Xiaoming

Xie, Huiqiang

Weng, Zhenzi

Fachgebiete

• Technische Wissenschaften Elektronik | Nachrichtentechnik Nachrichten- und Kommunikationstechnik Drahtlostechnologie
• Technische Wissenschaften Elektronik | Nachrichtentechnik Nachrichten- und Kommunikationstechnik Signalverarbeitung
• Mathematik | Informatik EDV | Informatik Informatik Künstliche Intelligenz

Inhaltsverzeichnis

Foreword ix

Preface xi

Acknowledgments xv

Acronyms xvii

Notations xxi

1 Introduction 1

1.1 Conventional Communications vs. Semantic Communications  2

1.1.1 Three-Level Communications. 2

1.1.2 History of Semantic Communications. 5

1.2 Introducing Deep Learning to Semantic Communications. 6

1.2.1 Deep Learning Basics. 6

1.2.2 Deep Learning Enabled Semantic Communications. 17

1.3 Semantic Communications for Further Networks. 20

2 Semantic Information Theory 31

2.1 Semantic Entropy. 31

2.1.1 Logical Probability-based. 32

2.1.2 Synonymous mapping-based. 34

2.1.3 Fuzzy Theory-based. 37

2.1.4 Task-based. 38

2.2 Semantic Channel Capacity. 38

2.2.1 Logical Probability-based. 39

2.2.2 Sympuous Mapping based. 40

2.3 Semantic Source Coding Theorem. 41

2.3.1 Logical Probability-based. 42

2.3.2 Sympuous Mapping-based. 43

2.4 Semantic Channel Coding Theorem. 44

2.4.1 Logical Probability-based. 44

2.4.2 Synonymous Mapping-based. 44

2.5 Information Bottleneck. 45

2.5.1 Classical Information Bottleneck. 45

2.5.2 Knowledge Collision based Information Bottleneck. 47

3 Joint Semantic-Channel Coding for Source Reconstruction 51

3.1 Semantic Communications for Text. 52

3.1.1 Joint Semantic-Channel Coding for Text. 54

3.2 Semantic Communications for Speech. 58

3.2.1 Joint Semantic-Channel Coding for Speech. 60

3.3 Semantic Communications for Image. 64

3.3.1 Joint Semantic-Channel Coding for Image. 66

3.4 Performance Metrics. 71

3.4.1 Performance Metrics for Text Accuracy. 71

3.4.2 Performance Metrics for Speech Quality. 74

3.4.3 Performance Metrics for Image Quality. 74

4 Task-Oriented Semantic Communications 85

4.1 Single-Modal Task-Oriented Semantic Communications. 86

4.1.1 Semantic Communications for Machine Translation 86

4.1.2 Semantic Communications for Speech Recognition and Synthesis. 91

4.2 Multimodal Task-Oriented Semantic Communications. 104

4.2.1 Semantic Communication Systems for Visual Question Answering. 104

5 Joint Sensing and Semantic Communications 115

5.1 Introduction and Framework of Joint Sampling and Coding. 116

5.2 Joint Semantic Sampling and Coding for Image. 119

5.2.1 Semantic-aware Image Compressed Sensing. 120

5.2.2 Adaptive Sampling and Semantic-Channel Coding. 127

5.3 Joint Semantic Sampling and Coding for Video. 135

5.3.1 Semantic-based Video Sampling and Reconstruction 137

6 Semantic Impairments in Communications 145

6.1 JSCC Framework with Semantic Impairments. 146

6.2 Source Semantic Impairments Suppression. 149

6.2.1 Robust Semantic Communications for Text. 149

6.2.2 Robust Semantic Communications for Speech. 157

6.2.3 Robust Semantic Communications for Image. 165

6.3 Knowledge Base Semantic Impairments Suppression. 177

6.3.1 Robust Semantic Knowledge Base. 178

7 Generative AI Enabled Semantic Communications 191

7.1 Introducing Generative Models to Semantic Communications. 191

7.2 Framework of Generative Semantic Communications. 195

7.2.1 Main Components of Generative Semantic Communication System. 197

7.2.2 Key Interactions and Processes. 201

7.3 Demonstration of Generative Semantic Communication for Video Conferencing. 203

7.4 Applications of Semantic Communications in Other Scenarios. 206

7.4.1 Immersive Communications. 206

7.4.2 Autonomous Driving. 208

7.4.3 Smart Cities. 209

7.4.4 Satellite Networks. 210

8 Conclusions and Challenges 217

Über Autor(innen)

Zhijin Qin is an Associate Professor with Tsinghua University, China. She is an Associate Editor for IEEE Transactions on Communications, IEEE Transactions on Cognitive Networking, and IEEE Communications Letters.

Dr. Huiqiang Xie, is an Associate Professor at Jinan University, Guangzhou, Guangdong, China.

Zhenzi Weng is a Postdoctoral researcher at Imperial College London, UK.

Xiaoming Tao is a Professor with the Department of Electronic Engineering at Tsinghua University. She is also a Senior Member of the IEEE.