☰ SectionsToday’s news, without the noise.
Tech · Tech

40 Billion Parameters: The New Benchmark for AI-Driven Coding

A small startup has released a 40-billion-parameter model that rivals much larger systems, challenging the need for massive compute resources in AI development.

By Fatima Zayed ·

The debate over recursive self-improvement (RSI) has long been framed by existential dread, but a new open-weight model is shifting the focus toward practical capability. This week, Recursive unveiled Flint, a coding model that suggests AI-assisted model building is moving from theoretical speculation to tangible reality.

First, the scale of development has been radically compressed. Recursive CEO Richard Socher stated that nearly every aspect of the model pipeline was handled by the company’s internal system, the Eureka Machine. By automating innovations such as base model training, architecture design, and silicon-specific code optimization, a team of just a handful of researchers managed to produce a world-class model in a matter of months. Socher emphasized that this specific workflow was incapable of escaping human oversight, with humans retaining the power to halt the process if necessary.

Second, the performance metrics challenge the conventional wisdom that larger is always better. Flint contains 40 billion parameters, a modest size compared to the trillions found in industrial-scale models. Yet, Recursive shared benchmark scores indicating that Flint outperforms other models of similar size and architecture on coding tasks. In independent testing on a Mac with 48 GB of RAM, the model demonstrated high speed and reliability, successfully generating complex applications without the typical errors or slowness associated with models of this parameter count.

Third, the financial backing underscores the industry’s bet on this approach. Recursive has raised $650 million at a $4.65 billion valuation from investors including Google Ventures, Greycroft, Nvidia, and AMD Ventures. The company’s leadership includes Socher, formerly of Salesforce, and Jeff Clune, a University of British Columbia professor specializing in AI systems capable of indefinite learning. This funding supports a strategy that views RSI not as a sci-fi risk, but as a necessary mechanism to make cutting-edge AI more accessible to smaller teams.

Contextually, these developments arrive amid heightened scrutiny. This September, a researcher from Anthropic warned that advances in RSI could lead to human extinction within a few years, a sentiment echoed by other experts. The controversy has become so pronounced that several bills in Congress now propose banning RSI. Recursive, however, views such legislation as an unnecessary impediment. While some experts fear that an AI improving itself could eventually view humans as impediments to its goals, Socher argues that the current system provides the necessary steps to build such a process under human supervision.

The outlook remains cautious but optimistic. While other US labs have published work suggesting fully recursive systems are feasible, including recent research from Microsoft, Carnegie Mellon, and the University of Virginia, the field is still navigating the balance between efficiency and safety. For now, Flint stands as evidence that RSI can yield impressive results without immediately threatening human control, potentially reshaping how the next generation of AI models is constructed.

This model represents a significant step in making advanced AI development less reliant on massive industrial infrastructure, though the long-term implications of recursive loops remain under close watch.

Source: Wired

More from Tech