Arduino's 16 GB VENTUNO Q Runs a 744-Billion-Parameter AI Model From an SSD, and It Took 7 Minutes to Name Three Planets
Arduino's 16 GB VENTUNO Q Runs a 744-Billion-Parameter AI Model From an SSD, and It Took 7 Minutes to Name Three Planets
Staff
Arduino's VENTUNO Q board, with just 16 GB of RAM, successfully ran a 744-billion-parameter AI model by streaming it from an SSD. It's slow, taking seven minutes to name three planets, but…
[original story: Circuit Digest]