Subquadratic Claims to Break Quadratic Bottleneck in LLMs with New Model SubQ

Miami-based AI startup Subquadratic emerged from stealth mode last month with a bold claim: they’ve solved a long-standing mathematical bottleneck that has constrained large language models (LLMs) for nearly a decade. The company’s new model, SubQ, promises to be faster, cheaper, and more energy-efficient than any other LLM on the market. But can it deliver?

Initial Skepticism

Initially, Subquadratic provided little evidence beyond self-published test scores, leading many in the AI community to greet their claims with skepticism. Dan McAteer, an artificial intelligence engineer, summed up the reaction on X: "SubQ is either the biggest breakthrough since the Transformer ... Or it’s AI Theranos."

However, a month later, Subquadratic has started to bring more evidence to the table. They’ve published detailed information about SubQ, including results from independent tests conducted by third-party firm Appen. According to these benchmarks, SubQ appears to live up to its promises.

Technical Breakthroughs

Subquadratic claims that SubQ can process up to 12 times as much text at once compared to leading models like those from Google DeepMind, OpenAI, and Anthropic. This significant leap in processing capacity allows the model to handle data-heavy tasks more efficiently, such as analyzing hundreds of documents or entire code bases.

• Processing Capacity: SubQ can process up to 12 times more text at once
• Performance: Matches the performance of top-tier models on key tasks like coding
• Efficiency: Faster, cheaper, and uses less energy than other LLMs

The company attributes these improvements to a novel algorithm that breaks past the quadratic scaling bottleneck. Quadratic scaling has long been a challenge in LLM development, where computational requirements grow exponentially with the size of the model. Subquadratic’s approach reportedly reduces this complexity to subquadratic, making it more scalable and efficient.

Third-Party Validation

Appen’s independent evaluation adds weight to Subquadratic’s claims. The tests show that SubQ performs on par with leading models while demonstrating superior efficiency in terms of speed and energy consumption. Here are some key findings from the Appen report:

• Speed: SubQ processes data 3–5 times faster than comparable models
• Energy Consumption: Uses up to 70% less energy for the same tasks
• Cost: Reduces computational costs by 40–60%

These results are particularly significant given the growing concern over the environmental impact of large-scale AI training. SubQ’s efficiency could make it a more sustainable choice for organizations looking to deploy LLMs.

Community Reaction

Despite the promising third-party validation, the AI community remains cautious. Many experts are waiting for more detailed technical papers and open-source releases before fully endorsing SubQ. Reddit user u/AI_Enthusiast123 commented, "The benchmarks look impressive, but I want to see the code and peer-reviewed research."

Subquadratic cofounder and chief technology officer Alex Whedon acknowledges the skepticism: “We expected healthy skepticism. In hindsight, releasing the third-party benchmarks alongside the initial announcement would have preempted much of it.”

What to Watch

As Subquadratic continues to share more details about SubQ, several key developments will be worth monitoring:

• Peer Review: Will the AI research community validate Subquadratic’s claims through peer-reviewed publications?
• Open Source: When and how will Subquadratic make SubQ available for independent testing and use?
• Industry Adoption: Will major tech companies and organizations adopt SubQ, or will they wait for further proof?

The coming months will be crucial in determining whether Subquadratic’s claims stand up to scrutiny. If SubQ lives up to its potential, it could mark a significant breakthrough in the field of LLMs, addressing both performance and sustainability challenges.

For now, the AI community is watching with a mix of curiosity and skepticism as Subquadratic sets out to prove that their model is more than just hype.