In our universe, most information is not redundant
(Chan et al., 2023) claim that most information in our universe is not redundant. This creates an interesting conflict with Natural abstractions are functions of redundantly encoded information, since that makes natural abstractions special in sense.
There are two main reasons, why we should believe that information is not redundant most of the times:
a) Locality: For information to be redundantly represented in the universe, it needs to be present at multiple places within the universe. This means that is has to be mediated through multiple layers. But most interactions in the universe are local. E.g. information is redundantly conserved, if it is present over many iterations, but that is unlikely, given that interactions happen locally. (Have to make this point clearer and wrap my head around it as well)
b) Chaos: This seems more intuitive. Variables influence each other. So at each step, there is a change that another variable changes the variable you resample. Thus, over „long distances, most information is lost“.
Source: Chan, L., Lang, L. and Jenner, E. (no date) ‘Natural Abstractions: Key claims, Theorems, and Critiques’. Available at: https://www.alignmentforum.org/posts/gvzW46Z3BsaZsLc25/natural-abstractions-key-claims-theorems-and-critiques-1 (Accessed: 19 March 2023).