NVIDIA Jetson Orin Nano Super Developer Kit: The Affordable Generative AI Supercomputer

NVIDIA has just upped the ante in the embedded systems space with the release of the Jetson Orin Nano Super Developer Kit. This new kit is being touted as the most affordable generative AI supercomputer, making it a compelling option for developers and researchers looking to run complex workloads on a budget.

What’s New?

The Jetson Orin Nano Super Developer Kit builds upon the existing Jetson Orin Nano platform by offering enhanced performance and additional features. Here's what you need to know:

• Enhanced Performance: The "Super" designation comes with a significant boost in computational power, thanks to an upgraded GPU and CPU configuration.
• Generative AI Capabilities: It's now more capable of running generative AI models, making it suitable for tasks like natural language processing (NLP), image generation, and video synthesis.
• Affordability: Despite the performance upgrades, NVIDIA has managed to keep the price point competitive, making it an attractive option for small-scale projects or startups.

Technical Details

• GPU: The kit features an NVIDIA Ampere architecture GPU with 2048 CUDA cores.
• CPU: It includes a 6-core Arm Cortex-A78AE CPU (quad-core + dual-core configuration).
• Memory: 16 GB LPDDR5 memory at 51.2 GB/s bandwidth.
• Storage: 32 GB eMMC storage.
• Connectivity: USB 3.2 Gen 2, PCIe Gen4 x4, Gigabit Ethernet, and Wi-Fi/Bluetooth support.

Key Features

• CUDA X AI Software Stack: The kit comes with the full CUDA X AI software stack, which includes libraries for deep learning, computer vision, and robotics.
• JetPack SDK: The latest version of JetPack SDK (v5.0) is available for download, providing a comprehensive set of tools for development.
• Pre-trained Models: Access to a wide range of pre-trained models through the NVIDIA NGC catalog.

Workloads

The Jetson Orin Nano Super Developer Kit is designed to handle a variety of workloads:

• AI Inference: Run complex AI models in real-time, ideal for applications like object detection and image classification.
• Robotics: The kit's robust performance makes it suitable for robotics projects, including autonomous navigation and sensor fusion.
• Edge Computing: Deploy edge computing solutions that require high computational power but low latency.

Performance Benchmarks

• AI Inference: Up to 200 TOPS (trillion operations per second) of AI performance, a significant improvement over the previous generation.
• Power Efficiency: Despite the increased performance, the kit maintains a power consumption of only 15W in typical workloads.

Getting Started

If you already have a Jetson Orin Nano Developer Kit, you can upgrade it to the "Super" version by downloading the latest software from NVIDIA's developer portal. For new users, the kit is available for purchase from NVIDIA and its authorized partners.

Community Support

NVIDIA offers robust community support through forums, documentation, and tutorials. The Jetson community is active and provides a wealth of resources for developers at all levels.

Conclusion

The Jetson Orin Nano Super Developer Kit represents a significant step forward in the embedded systems landscape. Its combination of affordability, performance, and versatility makes it an excellent choice for developers looking to push the boundaries of generative AI on a budget.