The reality is you can find “evidence” for almost any narrative. Limit the sample size, cherry-pick studies, etc. Systematic reviews, meta analyses, and randomized controlled trials are all susceptible to selective interpretation/narrative fallacy.
@nntaleb 1/10
Science is assumed to be “evidence-based” but that term alone doesn’t mean much. What constitutes good evidence? How is evidence being used? Is it supporting or refuting a hypothesis? Was the hypothesis and experimental design predetermined or found ex post facto?
The reality is you can find “evidence” for almost any narrative. Limit the sample size, cherry-pick studies, etc. Systematic reviews, meta analyses, and randomized controlled trials are all susceptible to selective interpretation/narrative fallacy.
At the heart of the problem is the over-reliance on simplistic statistical techniques that do little more than quantify 2 things moving together.
Take Pearson’s correlation, based on covariance. Variation can increase simultaneously across 2 variables for countless reasons, most of which are spurious. Yet this simple notion of “causality” undergirds much of scientific literature.
Information-theoretic (entropy based) approaches on the other hand can assess *general* measures of dependence. Rather than some specialized (linear) view based on concurrent variation, entropy encompasses the amount of information contained in and between variables.
If you were genuinely interested in giving the term “evidence” an authentic and reliable meaning then the methods used to underpin an assertion would be rigorous.
We wouldn’t look to conveniently simplistic methods to denote something as evidential, rather we would look for a measure capable of assessing the expected amount of information held in a random variable; there is nothing more fundamental than information.
Consider Mutual Information (MI), which quantifies the amount of information obtained about one random variable through observing another random variable. This observing of the relationship between variables is what measurement and evidence is all about.
MI determines how different joint entropy is from marginal entropies. If there is a genuine dependence between variables we would expect information gathered from all variables at once (joint) to be less than the sum of information from independent variables (marginals).
If “evidence-based” science was genuinely invested in authentic measurement it would leverage *general* measures of dependence; that demands an approach rooted in information-theory. Without entropy you’re just picking data, choosing a narrative, and calling it “evidence.”
More from Science
I want to share my thoughts, as someone who has been so alarmed by the so-called "dissident" scientists like Gupta, Heneghan, Kuldorff, Bhattacharya, & Ioannidis who consider themselves brave Galileos unfairly treated by "establishment scientists." I will try not to swear. 1/n
I want to talk about 3 things:
‼️Their fringe views are inhumane, unethical junk science that promotes harm
‼️They complain that they've been marginalized but this is simply untrue
‼️I am sick of people telling me we have to "listen to both sides." There aren't 2 sides here 2/n
These 'dissident' scientists have consistently downplayed COVID-19, urging policymakers not to take aggressive control measures. They claim it is not a serious threat. Gupta even went on TV saying people under 65 shouldn't worry about it!
RECEIPTS
They have consistently argued that policymakers should just let the virus rip, in an attempt to reach herd immunity by natural infection. Kuldorff *continues* to argue for this even now that we have many highly effective, safe vaccines.
We've never controlled a deadly, contagious pandemic before by just letting the virus spread, as this approach kills & disables too many people. In Manaus, Brazil, 66% of the city was infected & an astonishing *1 in 500* people died of COVID-19
If this is true raises the question of why certain (fringe & unethical) views got access to No.10 while others were ignored... https://t.co/A75HrSEqo4
— Prof. Devi Sridhar (@devisridhar) December 13, 2020
I want to talk about 3 things:
‼️Their fringe views are inhumane, unethical junk science that promotes harm
‼️They complain that they've been marginalized but this is simply untrue
‼️I am sick of people telling me we have to "listen to both sides." There aren't 2 sides here 2/n
These 'dissident' scientists have consistently downplayed COVID-19, urging policymakers not to take aggressive control measures. They claim it is not a serious threat. Gupta even went on TV saying people under 65 shouldn't worry about it!
RECEIPTS
They have consistently argued that policymakers should just let the virus rip, in an attempt to reach herd immunity by natural infection. Kuldorff *continues* to argue for this even now that we have many highly effective, safe vaccines.
Focused Protection: The Middle Ground between Lockdowns and "Let-it-rip". An essay by Jay Bhattacharya (@Stanford), @SunetraGupta (@UniofOxford) and @MartinKulldorff (@Harvard). https://t.co/T8uLxSFwgh
— Martin Kulldorff (@MartinKulldorff) December 11, 2020
We've never controlled a deadly, contagious pandemic before by just letting the virus spread, as this approach kills & disables too many people. In Manaus, Brazil, 66% of the city was infected & an astonishing *1 in 500* people died of COVID-19