Gemini 2.5 Pro: A Major Upgrade with Enhanced Coding and Enterprise Capabilities

By The Engineer | June 5, 2025

The latest preview of Google’s Gemini 2.5 Pro is now available for developers to test before its general availability in a couple of weeks. This updated version builds on the May release and showcases significant improvements, particularly in coding capabilities and enterprise applications.

Technical Improvements and Benchmarks

Elo Score Gains

• LMArena: A 24-point increase to an impressive 1470 Elo score, maintaining its lead.
• WebDevArena: A substantial 35-point jump, bringing the score to 1443.

These gains highlight Gemini 2.5 Pro's continued dominance in these benchmarks, which are crucial for evaluating a model’s real-world performance and reliability.

Coding Benchmarks

• Aider Polyglot: Top-tier performance on this challenging coding benchmark.
• GPQA and Humanity’s Last Exam (HLE): Leading scores on these highly complex benchmarks that test math, science, knowledge, and reasoning capabilities.

User Experience Enhancements

Google has also addressed feedback from the previous 2.5 Pro release to improve the model's style and structure:

• Creativity: More creative responses.
• Formatting: Better-formatted outputs, making it easier to read and use in various applications.

Developer Tools and Control

Developers can now access the upgraded preview of Gemini 2.5 Pro through multiple platforms:

• Google AI Studio: Try it here
• Vertex AI: Access it here

Notably, Vertex AI has introduced thinking budgets, giving developers more control over cost and latency:

• Thinking Budgets: Allow developers to set limits on the computational resources used by the model, optimizing for both performance and efficiency.

Enterprise Applications

The updated Gemini 2.5 Pro is designed with enterprise-scale applications in mind:

• Stability: The new version will be generally available soon, ensuring a stable and reliable experience for large-scale deployments.
• Scalability: Optimized to handle the demands of enterprise environments, making it suitable for a wide range of business use cases.

How to Get Started

To start building with Gemini 2.5 Pro:

1. Google AI Studio: Create a new chat or project and select the "gemini-2.5-pro-preview-06-05" model.
2. Vertex AI: Navigate to the multimodal section and choose the same model for your projects.

Conclusion

The latest preview of Gemini 2.5 Pro represents a significant step forward in AI capabilities, particularly in coding and enterprise applications. With improved performance on key benchmarks and enhanced user experience, it’s well-positioned to meet the needs of developers and businesses alike. Try it out today and prepare for its general availability in the coming weeks.