Skip to main content

Entropy

I am reading two books at the same time: The Information by James Gleich and Cycles of Time by Roger Penrose.

By coincidence, both have Entropy at their core.

Roger Penrose develops Conformal Cyclic Cosmology (CCC), primarily from an analysis of the exceptionally low entropy at the the time of the Big Bang, and his argument that the theory of "inflation" in the early universe does not sync up with Entropy calculations.

Gleich, on the other hand, studies the rise of information, and while the whole book is interesting, I found the sections on Claude Shannon and the development of Information Theory to be the most interesting.  While I have used the outcome of Shannon's theory in some of my digital signal processing projects (years ago!), I did not know that his original insight was around Information Entropy.  That's pretty cool.

Why am I reading two books at once?  Well, the Penrose book is tough going!  The arguments are hard to follow, the writing is dense, and the diagrams are confusing.  I know where he is going (time exists before the Big Bang, and after the Big Crunch - rinse and repeat - and somehow Entropy increases all the way through this mess), but I am not following all of the connecting bits.

So, I am reading Gleick when I get stuck.  Amazingly, the high level descriptions of Entropy in The Information is giving me some insights into what Penrose is describing.  Lucky coincidence :-)


Popular posts from this blog

Gliese 581g

So...there is probably intelligent life out there.  As the old Monty Python saying goes, "I hope so, cause there certainly isn't much here on earth."  Case in point.  The video for Gliese581g is on MSNBC, and works fine in IE, but crashes in Chrome [ here ].
Post a Comment
Read more

Acsoi - Land Grab Economics

"Adjusted Consolidated Segment Operating Income" ( Acsoi ), is a measure of what a companies profits would be if they were not spending like crazy to acquire a space:  in GroupOn's case, this would be retailers. To me, using Acsoi as a measure is really an admission that a company has no staying power beyond brand awareness.  So, they need to grab and own as much mindshare as they can, as quickly as they can, to increase the barrier to entry for competitors.  Without intellectual property to help protect them, and with the cost of switching (for a user) being effectively zero, building a global brand, and relying on brand stickiness, is the best way forward. Companies like Amazon that have been effective at this have also built in other "sticky" factors over time: recommendation engines, one-click purchasing, etc.  This increases the cost for the user to switch, and allows the company to stop pouring money into marketing and acquisition costs.  You also buil...
Post a Comment
Read more

Schrodinger's Cat is still Alive...and Dead

With Borders scaling back so many of their stores, I have ended up buying more books than I normally would. One I picked up is "What is Life?" by Ed Regis.  It is a good short read, although it is now 2 years old, which is a long time given the rate that "artificial life" is moving at.  Since the book came out, Craig Ventor claims to have created the first artificial life . One thing I did not know was that Schrodinger wrote a book with the same title in 1944 which predicted the existence of a DNA-like molecule;  Crick actually credits Schrodinger with inspiring some of his early work. Ed Regis points out that Schrodinger's book never actually defines what life is; that is left hanging.  Interestingly, I felt the same about Regis's book.  While he argues that life is defined by having an "embedded metabolism" that argument still seems weak.  Carl Sagan pointed out, many years ago, that cars have a metabolism, which is hard to argue against....
Post a Comment
Read more