Appendix F: Relation to Information Theory

This appendix clarifies the relationship between the informational framework developed in this work and established notions in information theory. While related, the concepts employed here are not reducible to classical Shannon information.

F.1 Information Beyond Shannon Entropy

Shannon entropy quantifies uncertainty in symbol distributions. It presupposes an underlying alphabet, probability measure, and observer.

In contrast, the informational field $I(x,t)$ represents ontological coherence. It measures the capacity of a system to sustain distinctions, correlations, and relational structure independently of observation.

Shannon entropy can be derived as an effective measure within localized, observer-defined subsystems, but it is not fundamental.

F.2 Relation to Algorithmic Information

Algorithmic information theory quantifies complexity via description length. The selection functional $\Xi$ includes a penalty term $\mathcal{D}(W)$ that plays a related but distinct role.

Rather than minimizing description length per se, $\Xi$ penalizes generative complexity that does not contribute to structural stability or coherence. This distinction allows for rich structure without overfitting or instability.

F.3 Information as Relational Structure

Information in this framework is fundamentally relational. It is defined by the existence of stable distinctions and correlations, not by symbols or bits.

This aligns with structural and semantic approaches to information, but extends them by assigning information an ontological role. Physical reality is one mode of relational information becoming self-consistent.

F.4 Entropy, Coherence, and Phase Transitions

The entropy functional used in simulations:

resembles Shannon entropy but has a different interpretation. It quantifies dispersion of coherence, not ignorance.

Phase transitions—such as the emergence of locality or the breakdown of spacetime—correspond to qualitative changes in informational organization, not to information loss.

F.5 Information Conservation Revisited

Information conservation in this framework does not mean conservation of bits. It means preservation of relational structure across representational phases.

This resolves apparent paradoxes associated with black holes and cosmology without requiring hidden degrees of freedom or external observers.

F.6 Summary

The theory is compatible with information theory but not reducible to it. Information is elevated from a descriptive tool to the fundamental substrate from which physics emerges.