#informationtheory

Spacetime is an evolved user interface This is a NotebookLM deep dive audio episode created from 40 sources exploring the **hard problem of consciousness **and the philosophical challenges of reconciling

突然觉得信息论超级重要！那么什么是信息论？用来干嘛的，一个理工科需要知道，那么文科生也需要知道吗？是的！ 信息论本质上是关于通信的理论。我们现在的社会，除了吃饭睡觉，人类的大部分时间都在做和通信有关的事情。我们平常上课，开会，和别人聊天。看视频，看书。。。这些都是某种形式的通信，而通信所传输的则是某种信息。

There is a saying that goes "The whole is greater than the sum of its parts". However, in information theory, or algorithmic information theory to be precise, the whole can be much much smaller

Sooo, how good are your passwords? The strength of a password is ultimately defined by how long time a "guessing algorithm" would take (on the average) to find it. Let's say you pick your password

This is a continuation of my last post An introduction to algorithmic information theory PART 1 Andrey Kolmogorov In the last article we asked whether we could prove that incompressible bitstrings exist.

I will be posting a series of posts that is an introduction to algorithmic information theory (AIT), that will be needed for my coming posts. Don't miss my previous post (which actually already used some

Usually the argument is being made that mathematics is unreasonably or surprisingly effective in describing the laws of nature, as if the laws of nature are expected to not be simple but instead random

What is that? Imagine Charles has an idea and he want to share it. There are so many ways to share an idea. He could draw a picture, write a song, send a telegraph or an email. But these things are different.