RWKV.cpp: Open-Source AI Model Ships with Every Windows 11 System

RWKV.cpp, an open-source AI model known for its efficiency and multilingual support, is now being deployed to half a billion systems worldwide. This significant milestone was achieved as the project became integrated into every new Windows 11 installation. Let's dive into what this means for developers and users alike.

What Changed Technically?

Integration with Microsoft Office:

• RWKV.cpp binaries are included in the latest Windows 11 updates.
• You can verify this by navigating to:
  • C:\Program Files\Microsoft Office\root\vfs\ProgramFilesCommonX64\Microsoft Shared\OFFICE16
• Alternatively, search for "rwkv" in system files on any "Copilot Windows 11" device.

Why It Matters

Open-Source and Apache 2.0 License:

• RWKV.cpp is licensed under the permissive Apache 2.0 license, making it one of the most widely deployed truly open-source AI solutions.
• This integration ensures that developers can inspect, modify, and redistribute the binaries.

Potential Use Cases

Local Copilot Features:

• Microsoft might be using RWKV.cpp to enhance local copilot features in Office applications.
  • Local Memory Recall: Improved ability to recall and process user data locally, enhancing privacy and performance.
  • Multilingual Support: RWKV models support over 100 languages, making them ideal for global deployment.

Technical Details

Efficiency and Performance:

• RWKV.cpp is known for its low energy consumption compared to transformer models, which is crucial for devices with limited battery life.
• The project supports INT4/INT5/INT8 and FP16 inference on CPU, enabling efficient execution on a wide range of hardware, including Raspberry Pi.

Community Contributions:

• The RWKV.cpp project has been built by the community to run RWKV models on nearly any device.
• You can find the source code and detailed documentation on GitHub:
  • RWKV/rwkv.cpp

Verification and Exploration

Decompiling Binaries:

• The binaries included with Windows 11 are real and can be decompiled for inspection.
• This transparency allows developers to understand how Microsoft is utilizing the model and potentially contribute improvements.

Community Engagement

Further Resources:

• For more information, visit the RWKV wiki:
  • wiki.rwkv.com
• Join the RWKV Discord server for community support and discussions:
  • discord.gg/bDSBUMeFpc

Conclusion

The integration of RWKV.cpp into Windows 11 marks a significant step in the adoption of open-source AI solutions. Its efficiency, multilingual capabilities, and community-driven development make it a valuable addition to Microsoft's offerings. As we continue to monitor this development, developers and users can look forward to enhanced local AI features and greater transparency in how these models are utilized.