Unlocking Next-Gen AI Performance: The NVIDIA Jetson Orin Nano Super Developer Kit
Summary
The NVIDIA Jetson Orin Nano Super Developer Kit is a powerful platform designed for edge AI applications, offering up to 70% higher generative AI performance. This compact system can handle a wide range of large language models (LLMs), visual language models (VLMs), and vision transformers (ViTs), making it an ideal choice for developers looking to deploy advanced AI models at the edge.
The Evolution of Edge AI
Edge AI has become increasingly important in various applications, from smart drones to intelligent vision systems. The need for powerful, compact, and energy-efficient platforms has driven the development of advanced AI hardware and software solutions. NVIDIA’s Jetson Orin Nano series has been at the forefront of this evolution, providing developers with a robust platform for creating next-gen AI-powered devices.
The NVIDIA Jetson Orin Nano Super Developer Kit
The Jetson Orin Nano Super Developer Kit is a significant upgrade to the original Jetson Orin Nano Developer Kit. This new version offers several key improvements:
- 1.7x Higher Generative AI Model Performance: The Jetson Orin Nano Super Developer Kit delivers up to 70% higher performance on generative AI workloads, enabling developers to run more complex AI models at the edge.
- 67 Sparse TOPs: This represents a significant increase from the previous 40 Sparse TOPs, providing more processing power for AI applications.
- 102 GB/s Memory Bandwidth: The increased memory bandwidth allows for faster data transfer and processing, enhancing overall system performance.
- 1.7 GHz CPU Clock Speed: The upgraded CPU clock speed provides additional processing power for demanding AI applications.
- New Reduced Price: The Jetson Orin Nano Super Developer Kit is now available at a lower price point of $249, making it more accessible to developers.
Key Features and Specifications
The Jetson Orin Nano Super Developer Kit includes a range of features and specifications that make it an ideal platform for edge AI development:
- GPU: 1024-core NVIDIA Ampere architecture GPU with 32 Tensor Cores
- CPU: 6-core Arm Cortex-A78AE v8.2 64-bit CPU
- Memory: 8GB 128-bit LPDDR5 with 68 GB/s memory bandwidth
- Storage: Supports external NVMe storage
- CSI Camera: Up to 4 cameras (8 via virtual channels) with 8 lanes MIPI CSI-2 D-PHY 2.1 (up to 20Gbps)
- Video Encode/Decode: Supports 1080p30 video encoding and 4K60 video decoding
- Networking: 1x Gigabit Ethernet (10/100/1000)
- Display: 1x 4K30 multi-mode DP 1.2 (+MST)/eDP 1.4/HDMI 1.4
Upgrading to the Jetson Orin Nano Super Developer Kit
Existing Jetson Orin Nano Developer Kit users can upgrade to the Jetson Orin Nano Super Developer Kit with a simple software update. This update includes a new power mode that increases the GPU, memory, and CPU clocks, unlocking the super performance mode.
To upgrade, follow these steps:
- Download the SD Card Image: Download the SD card image from the JetPack SDK page.
- Install JetPack 6.1: Install JetPack 6.1 with boosted performance for the Jetson Orin Nano Developer Kit using SDK Manager.
- Change the Power Mode: Use the command
sudo nvpmodel -m 2to change the power mode to MAXN mode, which enables the super performance.
Specifications Comparison
| Specification | Jetson Orin Nano 8GB | Jetson Orin Nano 4GB |
|---|---|---|
| AI Performance | 40 TOPS | 20 TOPS |
| GPU | 1024-core NVIDIA Ampere architecture GPU with 32 Tensor Cores | 512-core NVIDIA Ampere architecture GPU with 16 Tensor Cores |
| CPU | 6-core Arm Cortex-A78AE v8.2 64-bit CPU | 6-core Arm Cortex-A78AE v8.2 64-bit CPU |
| Memory | 8GB 128-bit LPDDR5 with 68 GB/s memory bandwidth | 4GB 64-bit LPDDR5 with 34 GB/s memory bandwidth |
| Storage | Supports external NVMe storage | Supports external NVMe storage |
| CSI Camera | Up to 4 cameras (8 via virtual channels) with 8 lanes MIPI CSI-2 D-PHY 2.1 (up to 20Gbps) | Up to 4 cameras (8 via virtual channels) with 8 lanes MIPI CSI-2 D-PHY 2.1 (up to 20Gbps) |
| Video Encode/Decode | Supports 1080p30 video encoding and 4K60 video decoding | Supports 1080p30 video encoding and 4K60 video decoding |
| Networking | 1x Gigabit Ethernet (10/100/1000) | 1x Gigabit Ethernet (10/100/1000) |
| Display | 1x 4K30 multi-mode DP 1.2 (+MST)/eDP 1.4/HDMI 1.4 | 1x 4K30 multi-mode DP 1.2 (+MST)/eDP 1.4/HDMI 1.4 |
Performance Comparison
| Model | Jetson Orin Nano Super | Jetson Orin Nano |
|---|---|---|
| LLaMA-3.1-8B | 1.7x faster | Baseline |
| VLM-1.1-4B | 1.5x faster | Baseline |
| ViT-1.1-4B | 1.4x faster | Baseline |
Getting Started
To get started with the Jetson Orin Nano Super Developer Kit, follow these steps:
- Download the SD Card Image: Download the SD card image from the JetPack SDK page.
- Install JetPack 6.1: Install JetPack 6.1 with boosted performance for the Jetson Orin Nano Developer Kit using SDK Manager.
- Change the Power Mode: Use the command
sudo nvpmodel -m 2to change the power mode to MAXN mode, which enables the super performance.
Additional Resources
For more information on the Jetson Orin Nano Super Developer Kit, including detailed specifications, performance benchmarks, and getting started guides, visit the NVIDIA Developer website.
Conclusion
The NVIDIA Jetson Orin Nano Super Developer Kit is a powerful platform for edge AI applications, offering significant performance improvements and a lower price point. With its compact design, numerous connectors, and up to 40 TOPS of AI performance, this developer kit is ideal for transforming visionary concepts into reality. Whether you’re developing smart drones, intelligent vision systems, or other AI-powered devices, the Jetson Orin Nano Super Developer Kit is the perfect tool to help you bring your projects to life.