) supercomputer designed for developers, hobbyists, and students. Priced at USD 249 (down from USD 499), the new kit delivers a 1.7x increase in generative AI inference performance and a 70 percent boost to 67 INT8 TOPS. Additionally, it provides a 50 percent increase in memory bandwidth, now reaching 102 GBps compared to its predecessor, Nvidia said on Tuesday. [More details](’
Few years back, I used to toy around with RPi 3B+ and most of the efforts went into optimising the models for RPi. Nvidia’s nano kit definitely is a nice alternative if full fledged system is not an option.
So to get a more powerful version at half the cost in stock would be a quite difficult. If it becomes available at say 25-30k I would be quite interested in getting one. Would be great for running a local LLM with a power consumption below 20 watts.
Jetson platform has a lot of models available. There a huge difference in power among the models. I don’t believe a SBC model of Jetson Orin Nano was ever available for 12k. Lowest was a $199 dollar version for a module which needs a carrier board which will cost you more than a mid ranged AM5 motherboard.
In India this 4gb module introduced in 2023 is 25k and will need another carrier board like a Avermedia D133 which will cost another 14k.
If you can get a more powerful newer version SBC for 249 USD. That a good deal.
Looking at specs the performance difference is double
Orin Nano had 512 cuda core and 16 tensor cores. Orin Nano Super has 1024 cuda cores and 32 tensor cores.
Orin AGX has 2024 cuda core and 64 tensor cores. (cost is usually over 1 lakh)
RTX 4060 GPU has 3072 cuda cores.
For older version of Jetson nano you can get it for around 5k for the lowest 2gb model. This model with 128 core maxwell GPU and a quad core CPU would be more powerful than a Raspberry Pi 4 for GPU intensive applications like AI, machine learning task.
In terms of AI
Jetson Nano Super does 68 INT8 TOPS
Intel ARC B580 does 233 INT8 TOPS (same price as jetson)
Nvidia 4060 does 242 INT8 TOPS
INT8 TOPS is a measure of 8 bit integer operations per second measured in trillions. So 68 trillion 8 bit integer operations executed per second for this SBC which consumes less than 20 watts of power.
[HEADING=2]NVIDIA Unveils Its Most Affordable Generative AI Supercomputer[/HEADING]
The Jetson Orin Nano Super delivers up to a 1.7x gain in generative AI performance, supporting popular models for hobbyists, developers and students.
NVIDIA is taking the wraps off a new compact generative AI supercomputer, offering increased performance at a lower price with a software upgrade.
The new [NVIDIA Jetson Orin Nano Super Developer Kit](’
), which fits in the palm of a hand, provides everyone from commercial AI developers to hobbyists and students, gains in generative AI capabilities and performance. And the price is now $249, down from $499.
Available today, it delivers as much as a 1.7x leap in [generative AI](’
) inference performance, a 70% increase in performance to 67 INT8 TOPS, and a 50% increase in memory bandwidth to 102GB/s compared with its predecessor.
Whether creating LLM chatbots based on [retrieval-augmented generation](’
BTW just asking as a newbie but can’t people build a pc with like 25k with GPU too by just collecting used parts ? yaa it does require more and power and non-portability too
