How much RAM do I actually need for local AI?

Running AI locally is a memory problem, not a hardware problem. The model file has to fit in your computer's RAM, and that's the only number that really matters. Here's how to pick the right amount without over-buying.

The three tiers

8 GB. Runs the small models, the 3 to 7 billion parameter ones. They handle basic writing, quick summaries, and simple questions. Enough to be useful, but you'll feel the ceiling.

16 GB. Runs the 7 to 13 billion parameter models comfortably. This is the sweet spot for most business writing. A model this size drafts your emails, summarises your documents, and answers questions about your files without breaking a sweat.

32 GB. Runs the 13 to 30 billion parameter models. Noticeably smarter, better at reasoning and nuance. Worth it if the AI is doing real heavy lifting, and it leaves room to grow.

Those "billion parameter" numbers are just the size of the model, the same way gigabytes measure a file. Bigger is not automatically better. A well-chosen 8 billion parameter model beats a poorly-chosen 30 billion one.

What you can ignore

The graphics card. Cloud AI runs on expensive GPUs, so everyone assumes you need one. You don't. A GPU makes things faster, and if you happen to have one, great. But it's optional, not a requirement. The engine I recommend runs every feature on the processor first, with the GPU as a bonus.

The "AI PC" marketing. You don't need special chips or the newest laptop. Those are for training models. You're running them.

Real numbers, in Dubai terms

A used office PC with 32 GB of RAM runs roughly 800 to 1,500 dirhams. That machine will write your emails, summarise your contracts, and answer questions about your own documents, all day, offline, for the cost of electricity. It pays for itself in months against what a cloud AI subscription would cost a small team in a year.

The short answer

16 GB is the sensible default for most businesses. Start with the machine you already have if it hits that bar. If you're buying something specifically for this, a used 32 GB desktop is the best value in the entire field, and it leaves you headroom.

If you'd rather skip the hardware question entirely, I'll spec it for you. I set up private AI for businesses in Dubai on hardware they own, and the first conversation about what you actually need is free.