Affordable AI Kit for Developers and Hobby

Emperor

Emperor

Juggernaut
Nvidia has launched the Jetson Orin Nano Super Developer Kit, a compact generative AI supercomputer designed for developers, hobbyists, and students. Priced at USD 249 (down from USD 499), the new kit delivers a 1.7x increase in generative AI inference performance and a 70 percent boost to 67 INT8 TOPS. Additionally, it provides a 50 percent increase in memory bandwidth, now reaching 102 GBps compared to its predecessor, Nvidia said on Tuesday. More details
 
  • Like
Reactions: ronnie_gogs and Emrebel
Few years back, I used to toy around with RPi 3B+ and most of the efforts went into optimising the models for RPi. Nvidia’s nano kit definitely is a nice alternative if full fledged system is not an option.
 
ronnie_gogs said:
The original Jetson Orin nano is still being sold for 50k or 580 USD


So to get a more powerful version at half the cost in stock would be a quite difficult. If it becomes available at say 25-30k I would be quite interested in getting one. Would be great for running a local LLM with a power consumption below 20 watts.
Click to expand...
I believe at that time it was available for around 12k
 
Emrebel said:
I believe at that time it was available for around 12k
Click to expand...

Jetson platform has a lot of models available. There a huge difference in power among the models. I don't believe a SBC model of Jetson Orin Nano was ever available for 12k. Lowest was a $199 dollar version for a module which needs a carrier board which will cost you more than a mid ranged AM5 motherboard.

In India this 4gb module introduced in 2023 is 25k and will need another carrier board like a Avermedia D133 which will cost another 14k.

tannatechbiz.com

NVIDIA Jetson Orin Nano 4GB Module

NVIDIA® Jetson Orin Nano™-series modules deliver up to 40 TOPS of AI performance in the smallest Jetson™ form-factor, with power options between 7W and 15W. This gives you up to 80X the performance of NVIDIA Jetson Nano and sets the new standard for entry-level edge AI.
tannatechbiz.com tannatechbiz.com

If you can get a more powerful newer version SBC for 249 USD. That a good deal.

Looking at specs the performance difference is double
Orin Nano had 512 cuda core and 16 tensor cores.
Orin Nano Super has 1024 cuda cores and 32 tensor cores.
Orin AGX has 2024 cuda core and 64 tensor cores. (cost is usually over 1 lakh)
RTX 4060 GPU has 3072 cuda cores.

For older version of Jetson nano you can get it for around 5k for the lowest 2gb model. This model with 128 core maxwell GPU and a quad core CPU would be more powerful than a Raspberry Pi 4 for GPU intensive applications like AI, machine learning task.
rees52.com

NVIDIA Jetson Nano 2GB Developer Kit Quad-Core ARM A57@1.43GHz Dev Kit

The NVIDIA Jetson Nano 2GB Developer Kit is a powerful, energy-efficient AI computing device that enables you to run multiple neural networks in parallel.
rees52.com rees52.com

In terms of AI
Jetson Nano Super does 68 INT8 TOPS
Intel ARC B580 does 233 INT8 TOPS (same price as jetson)
Nvidia 4060 does 242 INT8 TOPS

INT8 TOPS is a measure of 8 bit integer operations per second measured in trillions. So 68 trillion 8 bit integer operations executed per second for this SBC which consumes less than 20 watts of power.
 
tr27 said:
Definitely one of the bigger surprise announcement.
128 gb + cuda for prosumer was empty space in the market before this.. where only the high end mac was available as makeshift
I was so close to pull the trigger for the mac mini 2024, i will wait
Click to expand...

NVIDIA Unveils Its Most Affordable Generative AI Supercomputer​

The Jetson Orin Nano Super delivers up to a 1.7x gain in generative AI performance, supporting popular models for hobbyists, developers and students.

VC98qbK.png


NVIDIA is taking the wraps off a new compact generative AI supercomputer, offering increased performance at a lower price with a software upgrade.

The new NVIDIA Jetson Orin Nano Super Developer Kit, which fits in the palm of a hand, provides everyone from commercial AI developers to hobbyists and students, gains in generative AI capabilities and performance. And the price is now $249, down from $499.

Available today, it delivers as much as a 1.7x leap in generative AI inference performance, a 70% increase in performance to 67 INT8 TOPS, and a 50% increase in memory bandwidth to 102GB/s compared with its predecessor.

Whether creating LLM chatbots based on retrieval-augmented generation, building a visual AI agent, or deploying AI-based robots, the Jetson Orin Nano Super is an ideal solution to fetch.

Source: https://blogs.nvidia.com/blog/jetson-generative-ai-supercomputer/
 
  • Like
Reactions: Emperor
bssunilreddy said:

NVIDIA Unveils Its Most Affordable Generative AI Supercomputer​

The Jetson Orin Nano Super delivers up to a 1.7x gain in generative AI performance, supporting popular models for hobbyists, developers and students.

VC98qbK.png


NVIDIA is taking the wraps off a new compact generative AI supercomputer, offering increased performance at a lower price with a software upgrade.

The new NVIDIA Jetson Orin Nano Super Developer Kit, which fits in the palm of a hand, provides everyone from commercial AI developers to hobbyists and students, gains in generative AI capabilities and performance. And the price is now $249, down from $499.

Available today, it delivers as much as a 1.7x leap in generative AI inference performance, a 70% increase in performance to 67 INT8 TOPS, and a 50% increase in memory bandwidth to 102GB/s compared with its predecessor.

Whether creating LLM chatbots based on retrieval-augmented generation, building a visual AI agent, or deploying AI-based robots, the Jetson Orin Nano Super is an ideal solution to fetch.

Source: https://blogs.nvidia.com/blog/jetson-generative-ai-supercomputer/
Click to expand...
The 128gb memory is the real deal , Jetson ain't that.. just the bandwidth reveal remains
 
Top Bottom