I've heard this idea before, that civilization itself is already a misaligned intelligence, and that AI will merely amplify the existing tendencies.

https://www.youtube.com/watch?v=KCSsKV5F4xc

"People inside a moat, want to keep the moat from being breached because it fucks with their status quo."

EVERY.SINGLE.TIME. No shit, why would they want something disruptive to fuck with the way elite academia operates? And obviously I am talking about the "Master of the Universe" types atop the Ivory Tower. They have been A-OK, with privately-funded professorships, partnering with book publishers to milk students with single-access codes and never-ending "new" editions to their books, summer salary grants, partnering with all sorts of private companies as contractors, and/or milking on the tenure tit while the average adjunct lecturer at a local college/university struggles to make ends-meet and has 150 students in a lecture.

The author talks about his UC Berkeley years. That UC Berkeley that opened and operated for nearly a century as a public institution educating California's true middle class up until the 1960 Donahoe Master Plan, but slowly progressed to gate-keep "normies" out and pivoted to a model of elitism that is absolutely and catastrophically broken.

Fuck off.

How in god's name—irrespective of how valid this is, and its very valid—is this even remotely germane to the issue of AI in mathematics? Rattling off incidents and making the case that there is discrimination and sexists in mathematics (yeah no shit), how is this related to the issue of AI that was raised in the letter? Are the complaints raised in that letter any less valid because the mathematicians who signed them make part of a community which has reproachable behaviour, both past and present? I really don't get it.

I think the letter is misguided. So what if the AI labs are misaligned to math?

- But they announced a result before a paper was peer reviewed! The horror! So what? The mathematics community can read the paper once it is written up.

- But their results they publish may not care about conceptual understanding and insight! So what? If that's the mathematics community's goal, then they should sift through the lean proof and reformat the ideas to make them more insightful and develop their own conceptual understanding.

- But they aren't bothering to do literature review to tell the history about how humans contributed to the final result! So what? If it's so important to the mathematical community, they can do that themselves and throw a party every Tuesday in the honor of Luis Martínez-Zoroa and wear jeans on casual Friday in honor of Buckmaster and Alpöge - the left leg for Buckmaster and the right for Alpöge.

An AI giving a definite result of an open problem doesn't decrease the mathematical community's insight or conceptual understanding. They are still free to continue doing their work and pursuing their goals. If it's really so bad, they can just pretend they don't know NS is solved and keep spending their efforts trying to prove it never blows up (or a hand full of them can try to blow it up from scratch).

Guess what! I spend no part of my life working on unsolved math problems. I read some books for pleasure. I work in a hospitable with sick kids. I help my wife raise our kids. My goals are misaligned with the mathematics community! I've done nothing to increase conceptual understanding and insight! So what?