The Dark Night of Mathematics
105 points - today at 3:54 PM
SourceComments
Mathematicians should realize: instead of spending decades on individual theorems, you can now create whole new subfields of mathematics. Of course, you won't be doing the creation directly, in the way the mathematicians of old did; that's just not the name of the game anymore. But you will still be directing the research and involved in the creation.
As for squeezing in the time to do mathematics if the paying jobs disappear, there is a good chance we will have a world of plenty very shortly. I have a belief that the Austrian economists are right that there will always be plenty for humans to do and get rewarded for, but I also think that the costs of living will be so low that someone who wants to do mathematics will have plenty of time to do so. I hope this person holds the faith long enough and tries to see how the AI's can help accelerate one's own understanding. I am no fan of AIs generating a bunch of papers that no one reads or cares about, but I could say the same about the immense number of papers made by humans as well. If anything, the AIs make all of that immense knowledge more valuable as it is now knowable and accessible through these tools. There is also the fact that the mathematics job market has been oversaturated for at least 20 years. What our new tools allow is for people to be able to do mathematics outside of having access to a research library and top mathematics department.
There are a lot of reasons you might make a conjecture. Perhaps you are motivated by a search for structure: "We suspect that these objects behave like this, therefore we naturally imagine that...". But you might make a conjecture out of empirical evidence: "We checked 1 million examples, time to make a conjecture." While empiricism has its place in mathematics, it might not be the best motivation for a conjecture. As Bishop said, "Do not ask whether a statement is true until you know what it means." If you pose a conjecture based on empirical evidence, perhaps you should be thinking more about why you would imagine your statement be true in the first place.
I know some will think that this rings of goalpost moving, but when I hear about all these counterexamples spelling the end of mathematics as we know it, I just wonder how strong those conjectures really were in the first place. Again, I haven't actually dug into the specifics of any of the results so admittedly I could be totally off base, but I do know that not all conjectures are created equal.
I am not a mathematician, but this seems like an entirely non-problematic answer to me. Mathematics is ultimately the discovery of relations and their consequences, so of course large language models were eventually going to catch up. But precisely what they do lack is ability to appreciate these relations.
The author says mathematics is a spiritual pursuit.[1] I have asked LLMs about theological topics before and they have also been able to produce perfectly cogent answers (even heavy questions like âhow did Aquinas view Pseudo-Dionysiusâ negation-laden description of Godâ). I am not the least bit shaken by this, because it is still on me to evaluate and understand, and appreciate these answers.[2] The author seems to think LLMâs pattern recognition makes redundant human understanding and appreciation, which is a logical leap that doesnât make sense to me. Maybe the author is conflating utility and purpose? I feel bad, and hope the author takes care of themself, but I really think the author is taking a massive leap here. It is not that deep.
[1] I begrudgingly agree, but with the caveat that tending to a vegetable garden in your backyard is also a spiritual pursuit. Mathematics isnât some special discipline that elevates you beyond other people, as much as it is useful and interesting.
[2] I of course wouldnât consult an LLM if I actually wanted to educate myself or reason about these topics. Not only do I want to reason through them myself, but when it comes to issues in philosophy/theology/heavy stuff, you need to take in to account the perspective and experiences of the human writing them. LLMs muddle everyoneâs perspective together.
This is really beautiful. And no matter what happens, two things have to be true: some form of lively philosophic and religious richness will keep being a core part of our history and will touch every person in some way; and it will change enormously over time (maybe with math continuing to be a small part, maybe not).
There is a part of math that is like that. There's also another part (as Vladimir Arnold provocatively said):
> All mathematics is divided into three parts: cryptography (paid for by CIA, KGB and the like) hydrodynamics (supported by manufacturers of atomic submarines) celestial mechanics (financed by military and other institutions dealing with missiles, such as NASA).
> Cryptography has generated number theory, algebraic geometry over finite fields, algebra, combinatorics and computers.
> Hydrodynamics procreated complex analysis, partial differential equations, Lie groups and algebra theory, cohomology theory and scientific computing.
> Celestial mechanics is the origin of dynamical systems, linear algebra, topology, variational calculus and symplectic geometry.
Those parts can just be delegated to AI the same way they used to be delegated to mathematicians. But Arnold continued:
> The existence of mysterious relations between all these different domains is the most striking and delightful feature of mathematics (having no rational explanation).
LLMs just democratized that process.
For a mortal like myself, I've never discovered any new mathematics. All I can do is appreciate what I'm taught. But I can still appreciate it. I still watch videos of people solving high school/uni level questions. Why can't you appreciate this new counterexample, just because someone used an LLM to find it?
It's also worth looking at other times technology has changed our world. We invented various engines, so there's not a whole lot of economic value left in being a big strong guy anymore, but plenty of people still exercise because keeping in shape makes them happy.
> Something fundamental to the experience of mathematics is being taken.
That is the near term. At least "near term" like we talked about it five years ago. And it won't stop.
AI isn't a tame long term transition - in scale it is bigger than any transition since the first individual cells. In speed it is happening faster than web adoption. No human adoption bottleneck. They are taking the reins of our tools, and don't need human adaption to improve.
Ineffables, and our intellectual primacy are going away, right now, even as we think about it.
I am not making light of it. But not surprised, because how could AI not redefined everything.
But maybe not everything:
20 years from now, 50, 100, there will still be ineffable experiences at the frontiers, by different beings. I believe esoteric curiosity and the intrinsic rewards of discovery will continue. Our propensities to find idiosyncratic interests and pursuits, seek answers and adventures, exist in our psychology because the low median return is decisively outmatched the extremely hight mean returns of unanticipated progress. The benefits of many pursuits will be even greater for them.
It seems unlikely to me, that future beings will become less interesting.
I relate to the author. Anyone who isn't feeling butterflies or stones in their stomach, isn't really processing the moment.
lol who is paying for this? Mathematicians are generally paid to do other things and get to do this kind of work as a side effect.
> ... It revealed that the process of prompting novel proofs will be as auraless as ordering doordash. Watch as magic and mystery evaporate. Watch as the sun sets on our heroic age. Is there not something evil in the act of blocking all future generations of mathematicians from the experience of discovery? Forget about accuracy or even attribution. Something fundamental to the experience of mathematics is being taken."
These passages resonated with me, as someone who has been enchanted by writing software for almost 60 years. It crystalizes something that has been nagging at me for many years: I like writing software. Reviewing, testing, spec-ing, designing, etc. are all important, but they are all incidental to the actual creation of software. They are all necessary for me to do if I'm going to write software, but they are peripheral. I didn't latch on to computer programming because I got into flow state reviewing code, or spec-ing it.
And this is happening in one profession after another. For example, fighter pilots. I suspect that a fighter pilot feels about flying jet fighters the same way that I feel about programming. And he or she will soon be exactly as useless: Doing things related to flying, from the sidelines, but not doing the thing him or herself.
AI is stealing all the fun parts.
Both groups love math, but the later group is in a real bind because they have confounded their career with their hobbies/passions.
For years I've wanted to get back into self-studying mathematics, not to make serious contributions but just to appreciate its beauty; but the recent observation that I'll never be able to answer a pure mathematics question that a clanker could not has been off-putting, to say the least.
Unsaid here is that the companies involved have stolen so much (both literally in their plagiarism, and in their breaking of people's spirit), and given back so little. You still need to pay them cold, hard cash for them to help you prove theorems, and meanwhile, mathematicians working at these companies have themselves done little to contextualize and interpret results. That insight has mostly come from outsiders.
You need to be thinking about an entirely different form of life for all of humanity, happening in the very near future. Focusing on one specific field that may be earlier in the obsolescence chain is a distraction.
Merit based society based on intelligence or work of nearly any kind is about to cease existence.
For some reason it feels to me that this should make mathematicians feels better. :)
Regarding math, the new tools are humanity's achievements, they weren't handed down to us from the sky. These tools are spiritual achievements. Just as much as calculators and computers in general. Just as much as the invention of writing and notation. You could also mourn the days when we'd calculate on our fingers only and would orally memorize certain calculation heuristics of geometry handed down the generations.
Regarding jobs, people aren't being paid for having a good time or for having fun and spiritual feelings. When you get paid, someone gives you money. The person or institution giving you the money has to have a reason for doing this. It is very basic logic, but academics don't seem to get this. If your work is pleasing for someone on an artistic or spiritual level, you can find a rich patron, the same way learned scholars did back in the day.
It's not any different from cashiers who get replaced by self-checkout or bank tellers by ATMs. You're not special. It's a job.
And I say this as someone who really appreciates the feeling of gaining insight when cracking a math puzzle or grokking how the definitions fit together and why something is the way it is, why a theorem works, I like mathematical elegance etc. But I don't think that is diminished in the least by being able to consult a smart AI about it.
The joy and pride of lifting heavy chunks of mathematical infrastructure into place are being made redundant by industrial machinery that any amateur can rent or build for themselves. But it seems to me there's plenty of room to discover new mathematical vistas. The future of mathematical discovery is not cracking hard open problems that everyone in the math community agrees would be an impressive lift, but by bigging into things that nobody else thinks are interesting or important.
Suppose any theorem you set out to prove had already been proved in 100 wonderful ways
No matter how brilliant you are, no matter what intellectual heights you scale, you'll never be Pythagoras or Euclid or any of many famous mathematicians whose insights purchased immortality. Why even live?
To be frank, I occasionally feel this way because I am still absolutely knocked out by very simple things like plane geometry, powers, irrational numbers, exponentiation and logarithms etc. I smile and nod politely about reports of contemporary breakthroughs linking this obscure subfields with another - partly because I haven't put in the years of study to know a great deal about advanced and frontier topics, partly because I'm not smart enough to fully appreciate them, but mostly because they're often about the surprising obverse of some feature in a corner of a utility corridor in the dusty cellar of an annex in the grounds of the Grand Mathematical Temple. Nobody will be able to experience lighting a candle and illuminating the great structures of the main hall for the first time, just like no chemist can ever hope to wake up in the morning and discover a new element and most physicists have abandoned the idea that they will ever be able to do more than tinker around the periphery of the discipline in the hope of extending the precision of measurements by another decimal place.
But the amazement and perplexity about the unreasonable coherence of mathematics (and its equally unreasonable effectiveness in the natural sciences) are what make the field compelling in the first place. The capacity for curiosity and obsession are what yield big discoveries, more so fascination with extending a well-defined knowledge boundary out a little farther. Put another way, pointing out the existence of a problem can be more significant than solving it.
It was a struggle with a lot of dead ends but it is just software engineering. Itâs not a world away from getting a Rust program to type check.
The main problem I had with it is that LLMs will happily grind away case checking in Lean until the end of time and itâs up to you to see patterns and find dead ends. For example it wasnât until I suggested to try translating the problem to a different characteristic that Mythos one shotted the proof (and found a counterexample for a related question I was working on).
My main problem now is _what to do with it_. I am not an academic, donât know any academics and itâs a minor problem that I picked because I thought it was tractable and turned out to not be in the literature and fairly complicated, and the only reason I spent as much time on it as I did is that I thought I was an hour away from cracking it for about 10 of those days.
(In case anybody is curious about the proof, itâs that you canât compose a single two variable polynomial over the integers with itself and any number of integer constants via substitution to generate all polynomials, but you can with x^2 - y and 1/2 if you allow rational numbers)
Anyway, your "spiritual journey" doesn't matter. We'll automate mathematics because we can, because it's useful. Don't like it? Well, should have not chosen a capitalist economic system that rewards scientific progress so much.
First, this is about not just a job or career, but someone's identity. And we must have compassion that they are losing something that is fundamental to who they are. To them, it doesn't just feel like they're losing it, it is being taken by these companies that have so often acted in ways we despise
And that is a tragedy! And there are so many tragedies like this that will happen regularly as the technology advances
But my second reaction is one of this great shared experience. I studied math. Many of my friends are mathematicians. And it is now possible for anybody to access mathematical insights or think deeply about strange conjectures and theorems that were previously incomprehensible to anyone who hadn't at least studied mathematics in college
I don't know if 3b1b's Grant Sanderson considers himself a mathematician or science communicator, but I think of him as both. And while I expect he is someone with the mental capacity to find and prove new things in the world, I am grateful for the time he spends instead understanding things at a fundamental level and explaining and celebrating those concepts with his audience.
Not every mathematician can be or wants to be _that_ kind of mathematician. But for the moment, it is enough for me that higher mathematics is more accessible than ever.
And with some trepidation, I predict that the "traditional" job of a mathematician will change (of course it will). And it will change in big obvious ways and also subtle little ones. How will it change, though?
Importantly, math is actually going to be one of the fields where the fundamental things we thought we knew are shaken, because in the next five years we are going to start to see connections between things that were previously considered completely separate.
And so one way the job will change is that anyone who discusses math regularly will need to learn new things.
To me, this is exciting. It's almost like finding a bunch of new dinosaur fossils that fundamentally reshape our understanding. There's going to be a lot of work to do!
I stopped reading there.
Seriously how are we supposed to evaluate whether these were counterexamples to conjectures that real mathematicians had ever put any amount of effort into or not, if the author won't even link to them?
There are plenty of junk conjectures out there that even the conjucturee never spent time on.
What it has done in software engineering is kill all human open source spirit. There is hardly any new software out there, people do not talk about interesting things but just how AI "generates value" or similar nonsense. AI has stolen at least three potentially productive years.
The Leiden declaration is fine, but if people who make OpenAI ads like Tao sign it what do we make of it? Professors who are truly concerned should ban AI in universities, talk about IP theft to politicians and so on.
Found a new organization "Mathematicians against AI".