Promptfoo Joins OpenAI to Enhance AI Security and Evaluation

In a significant move for the AI testing ecosystem, Promptfoo has agreed to be acquired by OpenAI. Founded in 2024, Promptfoo quickly became a go-to tool for developers looking to systematically test their AI applications, particularly focusing on adversarial tests for security, safety, and behavioral risks.

What Changed Technically and Why It Matters

Key Changes:

• Acquisition by OpenAI: Promptfoo will now be part of OpenAI, bringing its robust testing platform into a larger ecosystem.
• Continued Open Source Commitment: Despite the acquisition, Promptfoo will remain open source and continue to serve users and customers.

Technical Impact:

• Enhanced Resources: OpenAI's vast resources and access to cutting-edge research in model and inference layers will supercharge Promptfoo's capabilities.
• Integration with Model Layers: The integration of Promptfoo’s core technology into OpenAI’s model and infrastructure layers will enable teams to catch vulnerabilities early, ensuring more secure AI deployments from the start.

What This Means for Users

For current Promptfoo users, this acquisition means:

• Improved Functionality: Enhanced features and performance through OpenAI's resources.
• Continuity of Service: The team will continue working with customers and users to ensure seamless service and support.
• Diverse Model Support: Continued support for a wide range of providers and models, reflecting the real-world complexity of AI systems.

Background and Impact

Promptfoo was founded to address the critical need for systematic testing in AI development. Adversarial tests for security, safety, and behavioral risks were identified as major blockers, especially for large enterprises. The platform's rapid growth is a testament to its effectiveness:

• User Base: Over 350k developers have used Promptfoo, with 130k active users monthly.
• Enterprise Adoption: More than 25% of the Fortune 500 rely on Promptfoo for their AI testing needs.

OpenAI's Role

By joining OpenAI, Promptfoo aims to:

• Maximize Impact: Leverage OpenAI’s resources and research to have a greater impact on how teams build and deploy AI.
• Early Vulnerability Detection: Integrate Promptfoo’s technology into the model and infrastructure layers to catch vulnerabilities early in the development process.

Team and Community

The success of Promptfoo is a collective effort:

• Investors: Gratitude to investors like Ganesh at Insight Partners, Zane at a16z, and other angel investors who supported rapid scaling.
• Team: The team grew quickly to 23 people across engineering, GTM, and operations, showcasing exceptional talent and hard work.
• Community: Thanks to everyone who contributed code, filed issues, used the product, or trusted Promptfoo in production.

Future Outlook

The acquisition is subject to customary closing conditions. Moving forward, the combined efforts of OpenAI and Promptfoo will focus on:

• Enhanced Security and Evaluation: Improving and integrating Promptfoo’s core technology to ensure secure and reliable AI.
• Continued Innovation: Maintaining the open-source suite as a best-in-class red teaming, static scanning, and evaluation tool.

Conclusion

The acquisition of Promptfoo by OpenAI marks a significant step forward in the AI testing and security landscape. With enhanced resources and integration into OpenAI’s ecosystem, Promptfoo is poised to continue its mission of helping developers ship secure, reliable AI applications.