[Fis] definitions of information by Theil (1972) derived from Shannon (1948); back to the basics?
joe.brenner at bluewin.ch
joe.brenner at bluewin.ch
Tue Jan 24 10:59:18 CET 2023
Dear All,
The last two messages, taken together, make a lot of sense: Howard's definition has the merit of simplicity, and Konstantin's necessary extension introduces the question of quality.
The only way I have found to answer it is to relax several abusive absolute dichotomies, in particular, that between 1) subjective and objective and 2) of their total separation.
In any specific case, I assume that the terms differ in degree of actuality and potentiality, not only, say, information and noise, relevancy and non-relevancy and similar pairs.
This approach excludes, however, talking about information at the level of quarks and their "associations" since nothing is added to the basic physics.
Thank you and best wishes,
Joseph
----Original Message----
>From : lidinkl at hotmail.com
Date : 24/01/2023 - 08:33 (E)
To : fis at listas.unizar.es, loet at leydesdorff.net, howlbloom at aol.com
Subject : Re: [Fis] definitions of information by Theil (1972) derived from Shnnon (1948); back to the basics?
P {
margin-top: 0;
margin-bottom: 0;
}
Thank you, Howard.
Your definition of information practically coincides with Shannon's definition, only elementary (sub-elementary) particles act as inductors and recipients.
In the next step, however, this approach leads us to the notion of information quality. A message can contain both a signal (relevant information) and noise. But the notion of relevance of information is subjective. Relevance is compliance with the goals that the inductor-recipient pair sets when exchanging information.
Do you think quarks and protons have goals and free will?
This is a very important question, because in most areas, except for the Shannon theory of communication, the quality of information is ignored. The subjectivity of this parameter looks too shocking to include it in a decent academic model (about the same way the Heisenberg uncertainty principle is still perceived)
From: Howard Bloom <howlbloom at aol.com>
Sent: 24 January 2023 08:21
To: lidinkl at hotmail.com <lidinkl at hotmail.com>; fis at listas.unizar.es <fis at listas.unizar.es>; loet at leydesdorff.net <loet at leydesdorff.net>
Subject: Re: [Fis] definitions of information by Theil (1972) derived from Shnnon (1948); back to the basics?
the definition of information in my book The God Problem: How a Godless Cosmos Creates:
information is anything a sender emits that a receiver can interpret.
the first information appears when the first quarks emerge in the first 10-34 of a second of the big bang. quarks read each other's social signals of attraction or repulsion and acted on them to gang up in groups of two or three, thus forming protons and neutrons, which also gave off social signals and agglomerated in proton-neutron teams.
with warmth and oomph--howard
-----Original Message-----
From: konstantin lidin <lidinkl at hotmail.com>
To: fis at listas.unizar.es <fis at listas.unizar.es>; Loet Leydesdorff <loet at leydesdorff.net>
Sent: Mon, Jan 23, 2023 1:31 pm
Subject: Re: [Fis] definitions of information by Theil (1972) derived from Shnnon (1948); back to the basics?
*#x_yiv5273111498 p {
margin-top: 0;
margin-bottom: 0;
}
Unfortunately, Shannon's definition can only be used in a very narrow class of cases. When we consider any process other than the transmission of a message from the inductor to the recipient, this definition does not work.
The most authoritative researchers of the philosophy of information admit that there is still no general definition. The concepts of information in different spheres differ significantly and cannot be combined into something commonly used
Baumgaertner, B., Floridi, L. Introduction: The Philosophy of Information.
Topoi
35, 157–159 (2016).
https://urldefense.com/v3/__https://doi.org/10.1007/s11245-016-9370-7__;!!D9dNQwwGXtA!TnOskB2TAWv-w-qjCwBtgGX-AVQ6NrmKPg_G-uz4ZWoSl-HijSd3B5OoASHObtp24505a0klXgNnNoSTiyruFFwhhL0$
From: Fis <fis-bounces at listas.unizar.es> on behalf of Loet Leydesdorff <loet at leydesdorff.net>
Sent: 23 January 2023 23:29
To: fis at listas.unizar.es <fis at listas.unizar.es>
Subject: [Fis] definitions of information by Theil (1972) derived from Shnnon (1948); back to the basics?
*#x_yiv5273111498 *#x_yiv5273111498x_xffee1d4888fa460cb226666f8b0a0764 p.x_yiv5273111498x_MsoNormal {
margin: 0.0in;
font-size: 10.0pt;
font-family: "Times New Roman" , serif;
}
*#x_yiv5273111498 *#x_yiv5273111498x_xd0f008326390429 *#x_yiv5273111498x_x37dfff32a36b4410ad8e891fea6bb1b8 a:visited {
color: rgb(149,79,114);
text-decoration: underline;
}
*#x_yiv5273111498 *#x_yiv5273111498x_xd0f008326390429 p.x_yiv5273111498x_MsoNormal {
margin: 0.0in;
line-height: 200.0%;
font-size: 12.0pt;
font-family: "Times New Roman" , serif;
}
*#x_yiv5273111498 *#x_yiv5273111498x_xd0f008326390429 a:link {
color: blue;
text-decoration: underline;
}
*#x_yiv5273111498 blockquote.x_yiv5273111498x_cite {
margin-left: 5.0px;
margin-right: 0.0px;
padding-left: 10.0px;
padding-right: 0.0px;
border-left: 1.0px solid rgb(204,204,204);
}
*#x_yiv5273111498 blockquote.x_yiv5273111498x_cite2 {
margin-left: 5.0px;
margin-right: 0.0px;
padding-left: 10.0px;
padding-right: 0.0px;
border-left: 1.0px solid rgb(204,204,204);
margin-top: 3.0px;
padding-top: 0.0px;
}
*#x_yiv5273111498 a img {
border: 0.0px;
}
Theil (1972) pp. 1 and 2:
1.1.
Information
Consider an event E with probability p; the nature of the event is irrelevant. At some point in time we receive a reliable message stating that E in fact occurred. The question is: How should one measure the amount of information conveyed by this message?
Information
Since the question is vague, we shall try to answer it in an intuitive manner. Suppose that p is close to 1 (e.g., p = .95). Then, one may argue, the message conveys very little information, because it was virtually certain that E would take place. But suppose that p = .01, so that it is almost certain E will not occur. If E nevertheless does occur, the message stating this will be unexpected and hence contains a great deal of information.
These intuitive ideas suggest that, if we want to measure the information derived from a message in terms of the probability
p
that prevailed before or to the arrival of the message, we should select a
decreasing
function. The function proposed by SHANNON (1948) is
when the probability prior to the message is zero) to 0 (zero information when the probability is one).
The unit of information is determined by the base of the logarithm. Frequently 2 is used as a base, which implies that any message concerning a 50-50 event has unit information: h() = log
2
2 = 1, and information is then said to be measured in binary digits or, for short,
bits.
When natural logarithms are used, the information unit is a
nit.
best, loet
_______________
Loet Leydesdorff
"The Evolutionary Dynamics of Discusive Knowledge"(Open Access)
Professor emeritus, University of Amsterdam
Amsterdam School of Communication Research (ASCoR)
loet at leydesdorff.net ; https://urldefense.com/v3/__http://www.leydesdorff.net/__;!!D9dNQwwGXtA!TnOskB2TAWv-w-qjCwBtgGX-AVQ6NrmKPg_G-uz4ZWoSl-HijSd3B5OoASHObtp24505a0klXgNnNoSTiyrubliMJzM$
https://urldefense.com/v3/__http://scholar.google.com/citations?user=ych9gNYAAAAJ&hl=en__;!!D9dNQwwGXtA!TnOskB2TAWv-w-qjCwBtgGX-AVQ6NrmKPg_G-uz4ZWoSl-HijSd3B5OoASHObtp24505a0klXgNnNoSTiyrus37kqMk$
ORCID: https://urldefense.com/v3/__http://orcid.org/0000-0002-7835-3098__;!!D9dNQwwGXtA!TnOskB2TAWv-w-qjCwBtgGX-AVQ6NrmKPg_G-uz4ZWoSl-HijSd3B5OoASHObtp24505a0klXgNnNoSTiyrul52hCrM$ ;
_______________________________________________
Fis mailing list
Fis at listas.unizar.es
http://listas.unizar.es/cgi-bin/mailman/listinfo/fis
----------
INFORMACIÓN SOBRE PROTECCIÓN DE DATOS DE CARÁCTER PERSONAL
Ud. recibe este correo por pertenecer a una lista de correo gestionada por la Universidad de Zaragoza.
Puede encontrar toda la información sobre como tratamos sus datos en el siguiente enlace:
https://sicuz.unizar.es/informacion-sobre-proteccion-de-datos-de-caracter-personal-en-listas
Recuerde que si está suscrito a una lista voluntaria Ud. puede darse de baja desde la propia aplicación en el momento en que lo desee.
http://listas.unizar.es
----------
__________________________
Howard Bloom
Howardbloom.net
https://urldefense.com/v3/__http://www.howardbloom.institute__;!!D9dNQwwGXtA!TnOskB2TAWv-w-qjCwBtgGX-AVQ6NrmKPg_G-uz4ZWoSl-HijSd3B5OoASHObtp24505a0klXgNnNoSTiyruq-PoxKM$
trailer for BRIC-TV's 66-minute film, The Grand Unified Theory of Howard Bloom, https://urldefense.com/v3/__https://youtu.be/rGkOkChazUQ__;!!D9dNQwwGXtA!TnOskB2TAWv-w-qjCwBtgGX-AVQ6NrmKPg_G-uz4ZWoSl-HijSd3B5OoASHObtp24505a0klXgNnNoSTiyrubCa1k3k$
Best Picture, Science Design Film Festival. Best Documentary Feature, Not Film Festival, Italy. Now available on Apple TV, Amazon, Google Play, Microsoft, Vimeo, Vudu, and Fandango.
Author of: The Lucifer Principle: A Scientific Expedition Into the Forces of History ("mesmerizing"-The Washington Post),
Global Brain: The Evolution of Mass Mind From The Big Bang to the 21st Century ("reassuring and sobering"-The New Yorker),
The Genius of the Beast: A Radical Re-Vision of Capitalism ("A tremendously enjoyable book." James Fallows, National Correspondent, The Atlantic),
The God Problem: How A Godless Cosmos Creates ("Bloom's argument will rock your world." Barbara Ehrenreich),
How I Accidentally Started the Sixties (“Wow! Whew! Wild! Wonderful!” Timothy Leary),
The Mohammed Code (“A terrifying book…the best book I’ve read on Islam.” David Swindle, PJ Media), and
Einstein, Michael Jackson & Me: a Search for Soul in the Power Pits of Rock & Roll ("Amazing. The writing is revelatory." Freddy DeMann, manager of Michael Jackson and Madonna), Best Book of 2020, New York Weekly Times.
A Quartz Magazine Pro
Former Visiting Scholar, Graduate Psychology Department, New York University, Former Core Faculty Member, The Graduate Institute; Current Kepler Space University Senior Scholar.
Founder: International Paleopsychology Project. Founder, Space Development Steering Committee. Member Of Board Of Governors, National Space Society. Founding Board Member: Epic of Evolution Society. Founding Board Member, The Darwin Project.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listas.unizar.es/pipermail/fis/attachments/20230124/9c7c1b52/attachment-0001.html>
More information about the Fis
mailing list