Anthropic’s latest flagship AI mannequin, Claude 3.7 Sonnet, price “just a few tens of hundreds of thousands of {dollars}” to coach utilizing lower than 10^26 FLOPs of computing energy.
That’s in accordance with Wharton professor Ethan Mollick, who in an X put up on Monday relayed a clarification he’d acquired from Anthropic’s PR. “I used to be contacted by Anthropic who informed me that Sonnet 3.7 wouldn’t be thought of a ten^26 FLOP mannequin and price just a few tens of hundreds of thousands of {dollars},” he wrote, “although future fashions can be a lot larger.”
TechCrunch reached out to Anthropic for affirmation however hadn’t acquired a response as of publication time.
Assuming Claude 3.7 Sonnet certainly price simply “just a few tens of hundreds of thousands of {dollars}” to coach, not factoring in associated bills, it’s an indication of how comparatively low-cost it’s turning into to launch state-of-the-art fashions. Claude 3.5, Sonnet’s predecessor, launched in fall 2024, equally price just a few tens of hundreds of thousands of {dollars} to coach, Anthropic CEO Dario Amodei revealed in a latest essay.
Those totals examine fairly favorably to the coaching worth tags of 2023’s high fashions. To develop its GPT-4 mannequin, OpenAI spent greater than $100 million, in accordance with OpenAI CEO Sam Altman. Meanwhile, Google spent near $200 million to coach its Gemini Ultra mannequin, a Stanford examine estimated.
That being mentioned, Amodei expects future AI fashions to price billions of {dollars}. Certainly, coaching prices don’t seize work like security testing and basic analysis. Moreover, because the AI trade embraces “reasoning” fashions that work on issues for prolonged intervals of time, the computing prices of operating fashions will possible proceed to rise.
