Abstract

Algorithmic information theory has a wide range of applications, despite the fact that its core quantity, Kolmogorov complexity, is incomputable. Most importantly, AIT allows to quantify Occam’s razor, the core scientific paradigm that ”among two models that describe the data equally well, the simpler one should be preferred”. This led to universal theories of induction and action in the field of machine learning and artificial intelligence, and practical versions like the Minimum Encoding Length (MDL/MML) principles. The universal similarity metric probably spawned the greatest practical success of AIT . Approximated by standard compressors like Lempel-Ziv (zip) or bzip2 or PPMZ , it leads to the normalized compression distance, which has been used to fully automatically reconstruct language and phylogenetic trees, and many other clustering problems. AIT has been applied in disciplines as remote as Cognitive Sciences, Biology, Physics, and Economics

Mini biography: Marcus Hutter is Senior Researcher at DeepMind and Professor in the RSCS at the Australian National University. He received his PhD and BSc in physics from the LMU in Munich and a Habilitation, MSc, and BSc in informatics from the TU Munich. Since 2000, his research at IDSIA and ANU and DeepMind has centered around the information-theoretic foundations of inductive reasoning and reinforcement learning, which has resulted in 200+ publications and several awards. His books on “Universal Artificial Intelligence” develop the first sound and complete theory of super-intelligent machines (ASI). He also runs the Human Knowledge Compression Contest (500’000€ H-prize). See https://www.hutter1.net/