In information theory, entropy quantifies the amount of information contained in a message. The unit used is usually bits : the numbers of zeroes and ones you need to represent the information.
If you have a fair coin and perform independent flips, the entropy or amount of information is 1 bit per flip. Every flip gives you an additional information : if the result is heads or tails (1 or 0)
If you have a source that gives the same value everytime, say an “rigged” dice that always turns up 6, the entropy of that source is 0 bits per roll. The next number is always six.
The source does not give value, it does not give additional information.
Here a a few good examples of zero (or almost zero) entropy sources:
(excerpts of tweets by the ABS-CBN News Channel on the #ANCForum 2009/10/20)
FOCAP question: Do you believe that RP continues to be ruled by political and economic elite? What are root causes of this?
Perlas
- I agree. We have the highest gini coefficient in region. Growth not benefiting wide sectors of society
- Our economy based on oligopolies and monopolies. This has to be addressed so growth becomes equitable .
- New gov’t should stop crony capitalism. This is source of ZTE, Northrail problems
Escudero
- I agree. Reason is patronage and traditional politics
- Elections make Filipinos equal. All of us have one vote and one vote each.
- Hopefully, we can empower and teach people that people have one vote and they believe in that power.
Estrada
- I believe that. I have personal experience. There are giant corporations owned by elite.
- During my presidency, giant corps want me to approve their petition. I told them, “My slogan is ERAP pampahirap if I approve that.”
Delos Reyes
- What matters is the principles of the party. I have to assert it in political mainstream.
- Major political parties control political milieu. Even if I’m a mere councilor, we have to break paradigm.
- I believe country is controlled by elite. No implementing rules for anti-political dynasty provision in Constitution
After reading these, did you learn something new? Was there additional value? (Granted, I just read the tweets and did not see the not the actual forum. For those who did, what’s the entropy?)