Skip to main content

Entropy

I am reading two books at the same time: The Information by James Gleich and Cycles of Time by Roger Penrose.

By coincidence, both have Entropy at their core.

Roger Penrose develops Conformal Cyclic Cosmology (CCC), primarily from an analysis of the exceptionally low entropy at the the time of the Big Bang, and his argument that the theory of "inflation" in the early universe does not sync up with Entropy calculations.

Gleich, on the other hand, studies the rise of information, and while the whole book is interesting, I found the sections on Claude Shannon and the development of Information Theory to be the most interesting.  While I have used the outcome of Shannon's theory in some of my digital signal processing projects (years ago!), I did not know that his original insight was around Information Entropy.  That's pretty cool.

Why am I reading two books at once?  Well, the Penrose book is tough going!  The arguments are hard to follow, the writing is dense, and the diagrams are confusing.  I know where he is going (time exists before the Big Bang, and after the Big Crunch - rinse and repeat - and somehow Entropy increases all the way through this mess), but I am not following all of the connecting bits.

So, I am reading Gleick when I get stuck.  Amazingly, the high level descriptions of Entropy in The Information is giving me some insights into what Penrose is describing.  Lucky coincidence :-)


Popular posts from this blog

The Centre Cannot Hold

Some thoughts on decentralization .  With all of the blockchain and Ethereum news, along with the dramatic uptick of ICO's, it is worth building a framework for decentralization.  The linked post makes a start on that.
Read more

Acsoi - Land Grab Economics

"Adjusted Consolidated Segment Operating Income" ( Acsoi ), is a measure of what a companies profits would be if they were not spending like crazy to acquire a space:  in GroupOn's case, this would be retailers. To me, using Acsoi as a measure is really an admission that a company has no staying power beyond brand awareness.  So, they need to grab and own as much mindshare as they can, as quickly as they can, to increase the barrier to entry for competitors.  Without intellectual property to help protect them, and with the cost of switching (for a user) being effectively zero, building a global brand, and relying on brand stickiness, is the best way forward. Companies like Amazon that have been effective at this have also built in other "sticky" factors over time: recommendation engines, one-click purchasing, etc.  This increases the cost for the user to switch, and allows the company to stop pouring money into marketing and acquisition costs.  You also buil
Post a Comment
Read more

Gliese 581g

So...there is probably intelligent life out there.  As the old Monty Python saying goes, "I hope so, cause there certainly isn't much here on earth."  Case in point.  The video for Gliese581g is on MSNBC, and works fine in IE, but crashes in Chrome [ here ].
Post a Comment
Read more