is an excellent scientist and a responsible professional. She likely read the paper more carefully than most. She grasped some of its strengths and weaknesses that are not apparent from a cursory glance. Below, I will mention a few points some may have missed.
1/

The paper does NOT evaluate the effect of school closures. Instead it conflates all ‘educational settings' into a single category, which includes universities.
2/
The paper primarily evaluates data from March and April 2020. The article is not particularly clear about this limitation, but the information can be found in the hefty supplementary material.
3/
The authors applied four different regression methods (some fancier than others) to the same data. The outcomes of the different regression models are correlated (enough to reach statistical significance), but they vary a lot. (heat map on the right below).
4/
The effect of individual interventions is extremely difficult to disentangle as the authors stress themselves. There is a very large number of interventions considered and the model was run on 49 countries and 26 US States (and not >200 countries).
5/
It is challenging to estimate the effect of interventions in the absence of a counterfactual. This difficulty is compounded by likely confounders, such as climate (not mentioned in the paper). Territories that implemented similar interventions might share comparable climate.
6/
This is a sophisticated piece of work, with both strengths and weaknesses. Though, to me, its primary value is the proposed methodological framework rather than its estimates of the efficacy of individual interventions, which efficacy remain debatable.
7/
There is room for scientific discussion about how solid the estimates presented in the paper may be. Though, accusing colleagues expressing reservations about the robustness of some of the findings of 'spreading disinformation' feels inadequate, to say the least.
8/
This paper has generated endless conflict. One intriguing feature is that all the spats are around 'educational settings'. Interestingly, the paper also claims that T&T and isolation of cases, among other measures, are completely ineffective, yet no one seems to care ... 🤔
9/

More from Science

1. I find it remarkable that some medics and scientists aren’t raising their voices to make children as safe as possible. The comment about children being less infectious than adults is unsupported by evidence.


2. @c_drosten has talked about this extensively and @dgurdasani1 and @DrZoeHyde have repeatedly pointed out flaws in the studies which have purported to show this. Now for the other assertion: children are very rarely ill with COVID19.

3. Children seem to suffer less with acute illness, but we have no idea of the long-term impact of infection. We do know #LongCovid affects some children. @LongCovidKids now speaks for 1,500 children struggling with a wide range of long-term symptoms.

4. 1,500 children whose parents found a small campaign group. How many more are out there? We don’t know. ONS data suggests there might be many, but the issue hasn’t been studied sufficiently well or long enough for a definitive answer.

5. Some people have talked about #COVID19 being this generation’s Polio. According to US CDC, Polio resulted in inapparent infection in more than 99% of people. Severe disease occurred in a tiny fraction of those infected. Source:
What are the classics of the "Science of Science" or "Meta Science"? If you were teaching a class on the subject, what would go in the syllabus?

Here's a (very disorganized and incomplete) handful of suggestions, which I may add to. Suggestions welcome, especially if you've dug into relevant literatures.

1. The already classic "Estimating the reproducibility of
psychological science" from the Open Science Collaboration of @BrianNosek et al.
https://t.co/yjGczLZ6Je

(Look at that abstract, wow!)


Many people had pointed out problems with standard statistical methods, going back decades (what are the best refs?). But this paper was a sledgehammer, making it impossible to ignore the question: what, if anything, were we actually learning from all those statistical studies?

2. Dean Keith Simonton's book "Creativity in Science: Chance, Logic, Genius, and Zeitgeist". If an essentially scientometric book could be described as a fun romp through science & creativity, this would be it

You May Also Like