When we say that "an algorithm is biased" we usually mean, "biased people made an algorithm." This explains why so much machine learning prediction turns into phrenology.

1/

Researchers with phrenological delusions ask machines to find statistical correlates of personalities or emotions, and machines dutifully provides them. It's high-stakes, machine-human collaborative apophenia, detecting patterns where none exist.

https://t.co/2b0IkQrI62

2/
Regrettably, this junk science gets published in respected journals. In 2017, @nature published a study by Stanford's Michal Kosinski claiming that machine learning could detect the facial correlates of homosexuality, creating an alleged AI gaydar.

3/
Unsurprisingly, Kosinski's study spectacularly failed to replicate. But as is so often the case, the blockbuster finding gets all the press, the careful replication work that calls it into doubt is roundly ignored.

https://t.co/J4rd6nLA4n

4/
Kosinski hasn't given up on AI phrenology. His lab's latest paper (published by Nature...again!) claims that he can detect political affiliation from social media photos.

https://t.co/kNPJ4vOwEr

5/
Spoiler: he can't.

What his system is most likely detecting is certain conventions in poses and expressions that are used in different political subcultures. Resting Karen face, basically.

6/
Unfortunately, this claim is being credulously reported in the tech press as true, even as the writer notes that this ML system barely outperforms random chance.

https://t.co/z1nkFFod3H

7/
Scientific racism has been with us for centuries. It's enjoying a renaissance today, driven in part by the neophrenologists of the ML world. They are the modern descendants of the caliper-wielding eugenicists of yore.

8/
To understand the genomic science that refutes all of this nonsense, you can read @AdamRutherford's brilliant, short, witty, vastly informative book HOW TO ARGUE WITH A RACIST. You'll be glad you did.

https://t.co/bPO3y5CzIX

9/
Image:
Cryteria (modified)
https://t.co/ICebVcdH1f

CC BY:
https://t.co/5YJhpDj3vT

eof/

More from Cory Doctorow #BLM

Today's Twitter threads (a Twitter thread).

Inside: Mashing the Bernie meme; Know Nothings, conspiratorialism and Pastel Q; and more!

Archived at: https://t.co/cKWPSzuYHE

#Pluralistic

1/


Mashing the Bernie meme: What if every video game, except Bernie with mittens?

https://t.co/Zcs71oUras

2/

More from Tech

You May Also Like

THREAD: 12 Things Everyone Should Know About IQ

1. IQ is one of the most heritable psychological traits – that is, individual differences in IQ are strongly associated with individual differences in genes (at least in fairly typical modern environments). https://t.co/3XxzW9bxLE


2. The heritability of IQ *increases* from childhood to adulthood. Meanwhile, the effect of the shared environment largely fades away. In other words, when it comes to IQ, nature becomes more important as we get older, nurture less.
https://t.co/UqtS1lpw3n


3. IQ scores have been increasing for the last century or so, a phenomenon known as the Flynn effect. https://t.co/sCZvCst3hw (N ≈ 4 million)

(Note that the Flynn effect shows that IQ isn't 100% genetic; it doesn't show that it's 100% environmental.)


4. IQ predicts many important real world outcomes.

For example, though far from perfect, IQ is the single-best predictor of job performance we have – much better than Emotional Intelligence, the Big Five, Grit, etc. https://t.co/rKUgKDAAVx https://t.co/DWbVI8QSU3


5. Higher IQ is associated with a lower risk of death from most causes, including cardiovascular disease, respiratory disease, most forms of cancer, homicide, suicide, and accident. https://t.co/PJjGNyeQRA (N = 728,160)