Qualcomm Cloud AI 100 Ultra – 150W AI Accelerator Card with 128GB at 548GB/s

qualcomm.com

170 points by peter_d_sherman 3 days ago


tokepi - 3 days ago

If the specs seem outdated, it’s because this chip launched in 2024. It’s available at cloud providers including Cirrascale

thway15269037 - 3 days ago

What's the price?

pearl_panel5 - 3 days ago

Curious how the memory bandwidth actually holds up under sustained inference loads compared to the spec sheet numbers.

swiftcoder - 3 days ago

So it's an M4 Max Mac Studio, RAM-wise, with a GPU's worth of compute?

zitterbewegung - 3 days ago

Sort of interesting design It has half a terabyte of SRAM on the accelerator with a 128 GB of RAM replacing HBM with SRAM but keeping regular RAM.

0917236141 - 3 days ago

Seems like a reasonable general-purpose card.

WarOnPrivacy - 3 days ago

Buy for the low, low price of - nope. Not for you.

    Cirrascale (8-card Ultra server, 128 GB each, 512 GB system RAM): 
    $4,699/mo (monthly term) or $3,759/mo (annual term)

    Cloud GPU rental (per-GPU): from $5.15/GPU/hr
ref: https://cloud-gpus.com/qualcomm-ai-100-ultra/
skavi - 3 days ago

is this hexagon?

aetherspawn - 3 days ago

Ok so it’s significantly worse than Apple M6 and we don’t know if it’s cheaper or not

Edit: Ah sorry you’re right, the bandwidth is lower but the TOPS is a lot higher. I’m not sure how much effect you get from higher TOPS with such low bandwidth though.

varispeed - 3 days ago

Aren't these specs already outdated? Seems meh. I would think players would like to bring something new to the table instead of bringing what was okay two years ago or so.

Give me 1TB RAM and 5TB/s or something that exciting.

g58892881 - 2 days ago

that's a slim card