When the university starts sending out teaching evaluation reminders, I tell all my classes about bias in teaching evals, with links to the evidence. Here's a version of the email I send, in case anyone else wants to poach from it.

1/16

When I say "anyone": needless to say, the people who are benefitting from the bias (like me) are the ones who should helping to correct it. Men in math, this is your job! Of course, it should also be dealt with at the institutional level, not just ad hoc.
OK, on to my email:
2/16
"You may have received automated reminders about course evals this fall. I encourage you to fill the evals out. I'd be particularly grateful for written feedback about what worked for you in the class, what was difficult, & how you ultimately spent your time for this class.

3/16
However, I don't feel comfortable just sending you an email saying: "please take the time to evaluate me". I do think student evaluations of teachers can be valuable: I have made changes to my teaching style as a direct result of comments from student teaching evaluations.
4/16
But teaching evaluations have a weakness: they are not an unbiased estimator of teaching quality. There is strong evidence that teaching evals tend to favour men over women, and that teaching evals tend to favour white instructors over non-white instructors.
5/16
Here is some specific information which may be useful if you wish to learn more about the biases described above:
6/16
Mengel, Sauermann, Zölitz - Gender bias in teaching evaluations. This one directly addresses mathematics courses, which I think is useful. The short version: female instructors receive lower evals than they deserve, mostly because of male students.
https://t.co/znL2HgtTSz
7/16
Boring - Reducing discrimination through norms or information. This one is a study which basically says that sending a message like this is a good idea!

https://t.co/eK6oD3I7sI

The conclusions of the study are as follows:
8/16
a) Simply reminding people not to be biased when filling out their teaching evaluations seems not to have an effect.
b) If as well as the reminder, you inform people that people that bias really does exist, in their exact setting, then does help reduce the resulting bias.
9/16
Chávez and Mitchell - Exploring Bias in Student Evaluations: Gender, Race, and Ethnicity. An experiment in the setting of an online course, which made it possible to compare variables in a much more controlled way.
https://t.co/3XVaLofLoe
10/16
.@mcgillu's report on gender equity in course evaluations (not peer-reviewed) shows statistically significant differences in course evaluations depending on the instructor's gender.

https://t.co/TO2HCgv4bT
11/16
This message feels particularly important as none of this is mentioned in McGill's guidelines for interpreting course evaluations (https://t.co/WSmNX8jCBn)
12/16
I hope you will all take seriously both the existence of this problem, and the idea that by paying attention, and having information about where and when this happens, you can actually help improve the situation. "
End email.
13/16
Then I include a P.S. with a few other references for any of my students who want to learn more:

* Carolina Women's centre - Teaching evaluations and bias
https://t.co/fGK3jTZZNg
14/16
* Bias in Student Evaluations of Minority Faculty: A Selected Bibliography

https://t.co/cKvcgP4Vt0
15/16
* Huston - Race and Gender Bias in Higher Education: Could Faculty Course Evaluations Impede Further Progress Toward Parity?

https://t.co/Vb76Q7TTZl
16/16

More from Education

New from me:

I’m launching my Forecasting For SEO course next month.

It’s everything I’ve learned, tried and tested about SEO forecasting.

The course: https://t.co/bovuIns9OZ

Following along 👇

Why forecasting?

Last year I launched
https://t.co/I6osuvrGAK to provide reliable forecasts to SEO teams.

It went crazy.

I also noticed an appetite for learning more about forecasting and reached out on Twitter to gauge interest:

The interest encouraged me to make a start...

I’ve also been inspired by what others are doing: @tom_hirst, @dvassallo and @azarchick 👏👏

And their guts to be build so openly in public.

So here goes it...

In the last 2 years I’ve only written 3 blog posts on my site.

- Probabilistic thinking in SEO
- Rethinking technical SEO audits
- How to deliver better SEO strategies.

I only write when I feel like I’ve got something to say.

With forecasting, I’ve got something to say. 💭

There are mixed feelings about forecasting in the SEO industry.

Uncertainty is everywhere. Algorithm updates impacting rankings, economic challenges impacting demand.

It’s difficult. 😩
We've been falsely told 'schools are safe', 'don't drive community transmission', & teachers don't have a higher risk of infection repeatedly by govt & their advisors- to justify some of the most negligent policies in history. 🧵


data shows *both* primary & secondary school teachers are at double the risk of confirmed infection relative to comparable positivity in the general population. ONS household infection data also clearly show that children are important sources of transmission.

Yet, in the parliamentary select meeting today, witnesses like Jenny Harries repeated the same claims- that have been debunked by the ONS data, and the data released by the @educationgovuk today. How many lives have been lost to these lies? How many more people have long COVID?

has repeatedly pointed out errors & gaps in the ONS reporting of evidence around risk of infection among teachers- and it's taken *months* to get clarity on this. The released data are a result of months of campaigning by her, the @NEU and others.

Rather than being transparent about the risk of transmission in school settings & mitigating this, the govt (& many of its advisors) has engaged in dismissing & denying evidence that's been clear for a while. Evidence from the govt's own surveys. And global evidence.

Why?

You May Also Like

🌺कैसे बने गरुड़ भगवान विष्णु के वाहन और क्यों दो भागों में फटी होती है नागों की जिह्वा🌺

महर्षि कश्यप की तेरह पत्नियां थीं।लेकिन विनता व कद्रु नामक अपनी दो पत्नियों से उन्हे विशेष लगाव था।एक दिन महर्षि आनन्दभाव में बैठे थे कि तभी वे दोनों उनके समीप आकर उनके पैर दबाने लगी।


प्रसन्न होकर महर्षि कश्यप बोले,"मुझे तुम दोनों से विशेष लगाव है, इसलिए यदि तुम्हारी कोई विशेष इच्छा हो तो मुझे बताओ। मैं उसे अवश्य पूरा करूंगा ।"

कद्रू बोली,"स्वामी! मेरी इच्छा है कि मैं हज़ार पुत्रों की मां बनूंगी।"
विनता बोली,"स्वामी! मुझे केवल एक पुत्र की मां बनना है जो इतना बलवान हो की कद्रू के हज़ार पुत्रों पर भारी पड़े।"
महर्षि बोले,"शीघ्र ही मैं यज्ञ करूंगा और यज्ञ के उपरांत तुम दोनो की इच्छाएं अवश्य पूर्ण होंगी"।


महर्षि ने यज्ञ किया,विनता व कद्रू को आशीर्वाद देकर तपस्या करने चले गए। कुछ काल पश्चात कद्रू ने हज़ार अंडों से काले सर्पों को जन्म दिया व विनता ने एक अंडे से तेजस्वी बालक को जन्म दिया जिसका नाम गरूड़ रखा।जैसे जैसे समय बीता गरुड़ बलवान होता गया और कद्रू के पुत्रों पर भारी पड़ने लगा


परिणामस्वरूप दिन प्रतिदिन कद्रू व विनता के सम्बंधों में कटुता बढ़ती गयी।एकदिन जब दोनो भ्रमण कर रहीं थी तब कद्रू ने दूर खड़े सफेद घोड़े को देख कर कहा,"बता सकती हो विनता!दूर खड़ा वो घोड़ा किस रंग का है?"
विनता बोली,"सफेद रंग का"।
तो कद्रू बोली,"शर्त लगाती हो? इसकी पूँछ तो काली है"।