Archives: Bookmarks

Measuring Implicit Bias in Explicitly Unbiased Large Language Models

Saved on January 2, 2025

Using these measures, we found pervasive stereotype biases mirroring those in society in 8 value-aligned models across 4 social categories (race, gender, religion, health) in 21 stereotypes (such as race and criminality, race and weapons, gender and science, age and
negativity). Our prompt-based LLM Implicit Bias measure correlates with existing language model embedding-based bias methods, but better predicts downstream behaviors measured by LLM Decision Bias. These new prompt-based measures draw from psychology’s long history of research into measuring stereotype biases based on purely observable behavior; they expose nuanced biases in proprietary value-aligned LLMs that appear unbiased according to standard benchmarks.

Few Americans Would Encourage a Young Person to Become a Teacher | NORC at the University of Chicago

Saved on December 31, 2024

Fewer than one in five Americans (18 percent) would encourage a young person to become a K-12 teacher, citing low pay, lack of sufficient school resources, and a stressful work environment as major barriers, according to NORC at the University of Chicago. These findings come amid a national teacher shortage and are from the latest NORC Spotlight on Education survey powered by AmeriSpeak®.

30 Years in Edtech-D’Arcy Norman dot net

Saved on December 31, 2024

One thing I’ve noticed is that the sense of creativity, curiosity, exploration, and playfulness that defined the multimedia and early Web eras feels to have been subdued over the last decade or so. Part of that is due to the maturity of software and tools. Part of it is the neoliberal erosion of institutions. Part of it is a product of a shift from a creator mindset to one of a consumer. Edtech is now commoditized, productized, sold to us. It promises efficiency and scale – so that we can better respond to things like restricted operational budgets – to do more with less.