PC advice · Local AI language

Local AI PCs for chat, coding and documents

Plan a local language-model PC around the model, context length and number of users, with a clear hardware-only scope.

By Vision Computing & Co · Updated

Illustrative black air-cooled PC in a coding workspace
Illustrative PC setup. Final case and components confirmed in your quote; peripherals excluded.

Name the model and the job

A local language-model PC should be planned around what you want it to do. Chat, code assistance and document work may use different models and settings. Send the model and runtime names if you know them; otherwise describe the task and choose I need advice.

Include whether this is for one person or several users and whether other applications will run at the same time. A model download size on its own does not describe the complete memory requirement of a working setup.

Discuss context as well as model size

Context is the information a model can work with during a request. A longer context can increase memory use, so a model tested with a short conversation does not establish the requirements for a large document or coding session.

Record the model version, quantisation if known, intended context and concurrency. These are more useful quote inputs than asking for a universal number of gigabytes that will run every model. Ollama's documentation explains how context settings relate to memory use.

Distinguish GPU memory from system RAM

GPU memory and system RAM have different roles. Extra system RAM should not be treated as an identical replacement for GPU memory. The selected runtime's hardware support and the way it runs your model need checking before choosing components.

Also consider storage for model files, documents and other applications. If you expect to run creative AI tools as well, include their models and output settings so both workloads are considered in the same hardware discussion.

Be clear about what is local

Using a local model does not establish that every connected tool operates offline. Check whether your chosen application uses cloud models, remote search, plug-ins or other network features. Hardware alone cannot guarantee a particular privacy outcome.

Our quote covers the PC build and itemised operating system. Model downloads, application configuration, document indexing, integrations, subscriptions and ongoing managed support are excluded. Discuss the exact software and licence requirements before selecting the hardware.

All PC advice · Quotes, invoices and delivery