Discussion about this post

User's avatar
Anatol Wegner, PhD's avatar

Frankly I find these types of defeatists posts by mathematicians hard to stomach. The common premise of these (Litt/Gowers and now this) is some variant of the idea that 'superhuman AI/AIs robustly better than humans in all aspects of mathematics ' are just arround the corner and these will fundamentally alter the way mathematics is valued and practiced.

However the evidence being provided for such claims is extremely thin not the least due to all the problems inherent to 'science/mathematics as AI hype/PR' mentioned in the post. But why should mathematics, out of all the disciplines, settle for blind trust in company announcements?- especially given their track record. And why abandon all norms and standards when it comes to AI and treat it differently from any other (dumb) computational method? - no matter how sophisticated.

Let's for instance consider the NS result. Leaving the scooping allegations aside, in this case we find that the solution was produced by last mile brute forcing a solution along a path that had already been worked out by human mathematicians via massively parallel stochastic search using an ungodly amount of compute in conjunction with expert human supervision and guidance - of which the extend again is unknown. Apart from that we are given nothing about the model architecture, training data and methodology, harness, prompts and/or human inputs and interventions. The same applies to almost all other major mathxAI results that have been announced. I am not even mentioning the absurdity of discussing "Credit" when we are not even given the names of the human contributors that were involved in producing said results.

Now mathematicians are asked to accept the mass of impenetrable brute facts produced by these machines as something that is "to human mathematics roughly what experimental data is to physics." and focus their attention and efforts to understanding and interpreting/digging through this ever growing mountain of slop proofs. Frankly I find it hard to imagine a more absurd way of doing mathematics.

And when asked how one is to be sure of the soundness of such results we are told to trust ever longer autoformalized lean proofs - Frankly I can't think of a sicker way of torturing poor Hilbert.

Of course in no other science would one for a second entertain the idea of taking outputs of an undisclosed experimental setup seriously. Here mathematicians are faced with the oldest trick in AI, dating back to Turing, where one is expected to attribute thought or general intelligence, or whatever one wants to call it in the context of mathematics, to a mystery machine based on what can only be described as anecdotal evidence. Not to mention the grand irony that todays math machines might very well include an undisclosed number of math phds toiling behind the curtains.

But of course "The proof was obtained via the following interactive workflow where X human mathematicians used $15M of compute and AI based automated search heuristics." does not sound nearly as grand as "Behold the latest mathematical revelation by our superhuman oracle."

And the grand result of all this are a collection of proofs that are mostly unintelligible, even to the machines. Given this dubious value of the results here the claim is essentially one of speed/efficiency - one aspect where machines always had the upper hand. Personally I would be more than willing to wait for a decade or two for a proper proof than settle for whatever this is supposed to be and let the AI companies and their minions drive their math bulldozers through the temple of mathematics.

I believe mathematicians would be much better of applying the rigorous scrutiny that is characteristic of their field to the fantastical claims being made rather than retreating into the cloak of metaphysical speculations or gesturing at the possibility of some superhuman future mystery machine. And when asked what exactly this übermenschliche machine is supposed to be all what we get is wild extrapolations of current, already highly overrated, model capacities into absurdity. But at it's core the idea is that of an oracle capable of solving all problems humanly possible, and presumably more, at the push of a button - a questions that was settled mathematically long before a computer ever calculated the first ten digits of pi.

Paraśurām's avatar

What a year to be completing a math PhD in huh 😭

49 more comments...

Ready for more?