Arduino's 16 GB VENTUNO Q Runs a 744-Billion-Parameter AI Model From an SSD, and It Took 7 Minutes to Name Three Planets

Arduino's 16 GB VENTUNO Q Runs a 744-Billion-Parameter AI Model From an SSD, and It Took 7 Minutes to Name Three Planets

Arduino's VENTUNO Q board, with just 16 GB of RAM, successfully ran a 744-billion-parameter AI model by streaming it from an SSD. It's slow, taking seven minutes to name three planets, but…

Staff

[original story: Circuit Digest]

Circuit Digest 26 Oct 01:14