Archives: Bookmarks
Asking a More Productive Question about AI and Assessment
“Given that AI exists in the world, and that students are likely to use it (whether accidentally or on purpose), what evidence of learning would I now fnd persuasive?”
Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity – METR
When developers are allowed to use AI tools, they take 19% longer to complete issues—a significant slowdown that goes against developer beliefs and expert forecasts. This gap between perception and reality is striking: developers expected AI to speed them up by 24%, and even after experiencing the slowdown, they still believed AI had sped them up by 20%.
Magenta RealTime: An Open-Weights Live Music Model
The lethal trifecta for AI agents: private data, untrusted content, and external communication
The lethal trifecta of capabilities is:
Access to your private data—one of the most common purposes of tools in the first place!
Exposure to untrusted content—any mechanism by which text (or images) controlled by a malicious attacker could become available to your LLM
The ability to externally communicate in a way that could be used to steal your data (I often call this “exfiltration” but I’m not confident that term is widely understood.)
AI for Scaling Legal Reform: Mapping and Redacting Racial Covenants in Santa Clara County
Despite the Supreme Court holding such racial covenants unenforceable in 1948, they persist in property records across the United States. Many jurisdictions have moved to identify and strike these provisions, including California, which mandated in 2021 that all counties implement such a process. Yet the scale can be overwhelming, with Santa Clara County (SCC) alone having over 24 million property deed documents, making purely manual review infeasible. We present a novel approach to addressing this pressing issue, developed through a partnership with the SCC Clerk-Recorder’s Office. First, we leverage an open large language model, fine-tuned to detect racial covenants with high precision and recall. We estimate that this system reduces manual efforts by 86,500 person hours and costs less than 2% of the cost for a comparable off-the-shelf closed model. Second, we illustrate the County’s integration of this model into responsible operational practice, including legal review and the creation of a historical registry, and release our model to assist the hundreds of jurisdictions engaged in similar efforts. Finally, our results reveal distinct periods of utilization of racial covenants, sharp geographic clustering, and the disproportionate role of a small number of developers in maintaining housing discrimination.
That white guy who can’t get a job at Tim Hortons? He’s AI | CBC News
In an interview with CBC News, he said he wanted to “have fun” with the idea held by some that “Indians are taking over the job market.” He says he created the “Josh” persona as a way of connecting with those who have similar views: young people just out of school who are looking for work.
I Deleted My Second Brain
For years, I had been building what technologists and lifehackers call a “second brain.” The premise: capture everything, forget nothing. Store your thinking in a networked archive so vast and recursive it can answer questions before you know to ask them. It promises clarity. Control. Mental leverage.
But over time, my second brain became a mausoleum. A dusty collection of old selves, old interests, old compulsions, piled on top of each other like geological strata. Instead of accelerating my thinking, it began to replace it. Instead of aiding memory, it froze my curiosity into static categories.
#Accesstive Will Get You Sued — Adrian Roselli
Regardless of the company making it, if you wonder if you should use an accessibility overlay, the answer is no. Accesstive’s overlay just happens to be the subject of this post.
I fight bots in my free time – Xe Iaso
“I have a Git server for my own private evil plans, and Amazon’s crawler discovered it through TLS certificate transparency logs and decided to unleash the hammer of God. And that happened. They had the flamethrower of requests just burning down my poor server, and it was really annoying because I was trying to do something and it just didn’t work. Also helps if you don’t schedule your storage on rotational drives.”