# overfitting (blogs) — RSS Amplifier Recent posts from the 1 feeds in the RSS Amplifier directory that cover overfitting. Page: Feed: --- ## [Why the simplest explanation is always the best](http://science-memo.blogspot.com/2025/11/simplest-explanation-always-best.html) _2025-11-16 · msuzen · Scientific Memo_ Preamble The simplest explanation is always the best among the explanations that are representative. It is called the principle of parsimony, Occam's razor . It is the bedrock of scientific enlightenment. There is a recent development that people start to do a category error to discard this principle based on the following setting that lead to misunderstanding: if we say that the simplest model… ## [Compressive algorithmic randomness: Gibbs-randomness proposition for massively energy efficient deep learning](http://science-memo.blogspot.com/2025/06/compressive-algorithmic-randomness.html) _2025-06-03 · msuzen · Scientific Memo_ Figure: Dual Tomographic Compression Performance, Süzen, 2025. Preamble Randomness is elusive and its probably one of the outstanding concepts for human scientific endeavour, along with gravity. Kolmogorov complexity, appears to be so novel in trying to answering "what is randomness?". The idea that the length of the smallest model that can generate the random sequence determines its complexity… ## [Ultimate physical limit of data storage: Connecting Bekenstein Bound to Landauer Principle](http://science-memo.blogspot.com/2025/04/ultimate-physical-limit-of-data-storage.html) _2025-04-23 · msuzen · Scientific Memo_ Preamble Bekenstein's Information (Wikipedia) Black holes are not too esoteric anymore after LIGO's success and successful imaging efforts. Their entropy behaves much different than the entropy of an ordinary matter. This leads to incredible discovery of so called holographic principle . The principle stating that we live on a projection of higher-dimensional manifestation of universe. On the…