A sense of astonishment and introspection is rippling through the forecasting community after an AI system developed by British startup ManticAI placed eighth in the highly competitive Metaculus Cup. The result is significant not just for its high ranking, but for the fact that it surpassed many seasoned human professionals, prompting one to call the experience “a weird feeling.”
The competition tested the predictive power of its entrants on 60 diverse global events over the summer. Participants had to forecast outcomes on subjects as varied as political leadership challenges and the likelihood of public feuds between high-profile billionaires. ManticAI’s success in this complex environment serves as a powerful testament to the growing reasoning abilities of artificial intelligence.
The AI’s method is one of strategic delegation. Co-founded by a former Google DeepMind scientist, ManticAI utilizes a suite of AI models from different developers. It assigns specific roles to each AI agent—some research the past, others game out future possibilities, and another synthesizes the information into a final probability. This persistent and multi-pronged analytical approach gives it a distinct advantage.
Toby Shevlane, the startup’s co-founder, emphasized that the AI’s performance is proof of its ability to reason, not just repeat information. He pointed out that the AI often held strong, non-consensus positions, making it a potential “antidote to groupthink.” This capacity for independent analysis challenges the conventional wisdom that humans cluster around, offering a fresh and often more accurate perspective.
Experts in the field, while acknowledging the AI’s impressive leap, note that humans still excel at forecasts requiring complex judgment and logic verification. Deger Turan of Metaculus believes AI will reach or exceed human capabilities by 2029. This sentiment is echoed by human forecasters themselves, with some, like third-place finisher Lubos Saloky, suggesting the best strategy is collaboration: “If you can’t beat them, merge with them.”
