Hasil untuk "Information theory"

I. Jacobs, J. Wozencraft

David E. Kaun, A. Spence

F. James

R. Macarthur

S. Rachman

H. Woxniakowski

T. Teyler, P. DiScenna

K. Devlin

M. Gredler

Pamela R. Haunschild, Christine M. Beckman

Peter R. Dickson

B. Avolio, S. Kahai, George E. Dodge

Saba Inam, Shamsa Kanwal, Marryum Niazi et al.

The combination of chaos theory and cryptographic methodologies constitutes a pivotal aspect of the information security. Owing to certain attributes of images, like their large data capacity and significant redundancy, image encryption needs specialized techniques instead of conventional text encryption. This study presents an innovative hybrid image encryption scheme that integrates Henon map–based key generation and involves diffusion process to ensure security and efficiency of the system. The experimental findings indicate that the methodology provides strong confusion and diffusion, low correlation between adjacent pixels, high entropy values close to 8, and number of pixel change rate (NPCR) above 99%. The method ensures secure image transmission using the same secret keys and maintains computational efficiency, making it suitable for practical applications in secure communication and multimedia protection. Unlike conventional Henon map–based encryption schemes, this study fuses Henon map–based key generation with error correction code (ECC) and an organized diffusion mechanism, enhancing both cryptographic robustness and reliability against channel errors during transmission.

W. Skaggs, B. McNaughton, K. Gothard

Yuliia Ovchar

The study is devoted to a comprehensive analysis of the functional characteristics of linguistic and stylistic means of emotional influence that function in the modern political discourse of the information space, forming political narratives to achieve emotional influence on the audience. The relevance of the study is accompanied by modern communication theory, which allows for a deep analysis of the influence of the media on human consciousness and the characteristics of the functional features of linguistic and stylistic means of emotional influence in political discourse. The purpose of the study is to analyze the functional characteristics of linguistic and stylistic means used for emotional influence in political discourse and to determine their role in the formation of public opinion and political behavior. The task of the study is to describe the functional features of the identified linguistic and stylistic means and to determine the contextual factors that determine the effectiveness of the use of various linguistic and stylistic means of emotional influence in political discourse. The study used the following research methods: analysis of scientific literature, content analysis, discourse analysis, and comparative analysis. The globalization of society in the 21st century and the increasing complexity of communication ties have made the issue of the influence of media on humans relevant. In the context of socio-economic and political shifts that break many familiar life stereotypes, the effect of the impact of the mass media on the audience is undesirable. The study contains a comprehensive and systematic approach to the functional characteristics of linguistic and stylistic means of emotional influence in political discourse, since in the context of the growing role of information technologies and media in political life and understanding the mechanisms of emotional influence allows us to critically evaluate political narratives, identify manipulative strategies and promote the development of media literacy in society. The analysis of these means in the context of modern political processes in Ukraine and the world is especially important.

Bo Bai

Large language models (LLMs) have demonstrated remarkable capabilities in numerous real-world applications. While the vast majority of research conducted from an experimental perspective is progressing rapidly, it demands substantial computational power, data, and other resources. Therefore, how to open the black-box of LLMs from a theoretical standpoint has become a critical challenge. This paper takes the theory of rate-distortion function, directed information, and Granger causality as its starting point to investigate the information-theoretic principles behind LLMs, leading to the development of semantic information theory for LLMs, where the fundamental unit is token, rather than bits that lacks any semantic meaning. By defining the probabilistic model of LLMs, we discuss structure-agnostic information-theoretic measures, such as the directed rate-distortion function in pre-training, the directed rate-reward function in post-training, and the semantic information flow in inference phase. This paper also delves deeply into the theory of token-level semantic embedding and the information-theoretically optimal vectorization method. Thereafter, we propose a general definition of autoregression LLM, where the Transformer architecture and its performance such as ELBO, generalization error bound, memory capacity, and semantic information measures can be derived theoretically. Other architectures, such as Mamba/Mamba2 and LLaDA, are also discussed in our framework. Consequently, this paper provides a theoretical framework for understanding LLMs from the perspective of semantic information theory, which also offers the necessary theoretical tools for further in-depth research.

L. Zadeh

F. Smarandache, J. Dezert

Zeshui Xu

A.G. Nalimov, V.V. Kotlyar

A combined high-aperture metalens in a thin silicon nitride film, which consists of two inclined sector metalens, is considered. Each sector metalens consists of a set of binary subwavelength gratings. The diameter of the lens is 14 μm. It has been shown using time-domain finite difference method that the metalens can simultaneously detect optical vortices with two topological charges –1 and –2, in almost the entire visible wavelength range. The metalens can distinguish several wavelengths that are focused at different points in the focal plane: a 1 nm change in wavelength results in a focal spot shift of about 4 nm. When the metalens is illuminated by a Gaussian beam with left-handed circular polarization, two optical vortices with topological charges 1 and 2 are simultaneously formed at 6 nm between each other at focal distance equals 6 nm. This metalens can be used to increase information in transmission channel in wireless telecommunication systems by selecting the space-time modes of laser radiation with different topological charges and different wavelengths. The considered microlens is an example of a compact demultiplexer.