Discussion (what it means or how it might be applied)
Entropy is the tendency of a system to progress away from order towards randomness.
The simplicity of an architecture is defined by the number of steps that are required to produce an output given an input.
The simpler a system architecture is the more entropy resilient that architecture is. This is because there are fewer parts that can break.