This, via @melaniemitchell.bsky.social is super helpful background on what is going on in background. "“Number one: It works. It improves things ...Number two: the chain of thought “isn’t necessarily faithful to what’s going on ... number three: A lot of that text isn’t even useful."
Is AI Reasoning Right for the Wrong Reasons? | Quanta MagazineThe idea that artificial intelligence can “reason” is more intuitive than ever. But intuitions can be wrong, and the science is far from settled.www.quantamagazine.org