Skip to main content

Entropy

I am reading two books at the same time: The Information by James Gleich and Cycles of Time by Roger Penrose.

By coincidence, both have Entropy at their core.

Roger Penrose develops Conformal Cyclic Cosmology (CCC), primarily from an analysis of the exceptionally low entropy at the the time of the Big Bang, and his argument that the theory of "inflation" in the early universe does not sync up with Entropy calculations.

Gleich, on the other hand, studies the rise of information, and while the whole book is interesting, I found the sections on Claude Shannon and the development of Information Theory to be the most interesting.  While I have used the outcome of Shannon's theory in some of my digital signal processing projects (years ago!), I did not know that his original insight was around Information Entropy.  That's pretty cool.

Why am I reading two books at once?  Well, the Penrose book is tough going!  The arguments are hard to follow, the writing is dense, and the diagrams are confusing.  I know where he is going (time exists before the Big Bang, and after the Big Crunch - rinse and repeat - and somehow Entropy increases all the way through this mess), but I am not following all of the connecting bits.

So, I am reading Gleick when I get stuck.  Amazingly, the high level descriptions of Entropy in The Information is giving me some insights into what Penrose is describing.  Lucky coincidence :-)


Popular posts from this blog

Pwned by CarShark

Here is your guide to "sharking" a car. With Carshark, and a little creativity, you to can make your drive to work more interesting.  In the paper they show you how to hook things up so that you can control a car through WiFi. You are sitting at a red light, and want to have a little fun.  How about sending 07 AE 15 A2; this controls the horn frequency?  Drive-by ringtones.  Could be a $1B business.

The Fourth R.

Reading, wRiting, aRithmetic, and algoRithms.  My wife and I were just brainstorming about this: how coding should be the next "basic" skill.  Of course, someone was ahead of us and posted this .  It is awesome to see Mozilla Hackasaurus referenced in this article.  It is a small world. In the early days of the printing press, scholars wrote the books; the press was simply used for production (see this article ).  As time went on, "average" people became familiar with the medium, and used it for their own messages.  We are at just that point with the Web.  Software Engineers write the code, and the Web distributes it.   Software Engineers are the algoRithm scholars of today.  They won't be for long.  Soon algoRithms will be taught starting in elementary school, along with the other three R's.

The Trouble with Physics

I enjoy reading layman physics books.  And, I enjoy the Science vs Religion debates, especially those that cast Science as a Religion. Superstring theory has always both intrigued and bothered me. Intrigued as, on the surface, it has a nice visual "ah ha" about it; the universe is comprised of tiny (zero dimension) vibrating strings, which can form chords and harmonies that result in manifestations that are available to the human senses. Bothered as, below the surface, it is a huge mess of mumbo-jumbo that has no intuitive sense to it.  Relative to relativity (sic), this is a fairly easy statement to make; even a layman can get a grasp of relativity through Einstein's own writings.  But, relative to quantum theory, can Superstring theory really have "no intuitive sense".  What I really mean is that superstring theory has no science behind it - no way to test anything.  Quantum theory, on the other hand, has been tested over and over again. [...