What we did with it
The chat inside our domain manager runs on Ollama, on our own desktop, with a model called qwen3.5:9b. We ask it things like which names renew next, and it answers from our own database.
| The machine | Intel i7-14700K, NVIDIA RTX 4070 with 12 GB, 64 GB of memory |
|---|---|
| The model | qwen3.5:9b, a 6.6 GB download |
| First question after a rest | 8.2 seconds, 7.3 of them loading the model |
| The next question | 1.7 seconds for a short paragraph |
| Output speed | About 75 tokens a second, both times |
Two questions on one afternoon, on one strong desktop. A number to compare with, not a benchmark.
The good
- Your words stay on your machine.With a local model nothing leaves the computer, and asking it a thousand times costs the same as asking once.
- Fast enough to talk to.Once the model is loaded, the answers come as quickly as you can read them on our desktop.
- Your own programs can use it.It answers at a local address, so our app talks to it the way it would talk to any paid AI service.
- It is open source.The software is under the MIT license.
The catch
- Not every model in its list is local.Some entries run on Ollama's own servers and carry "cloud" in the name. Those send your words out. Read the name before you assume it is private.
- Our figures are from a strong desktop.The model has to fit in memory. We have not tried it on a laptop, so we cannot tell you how that goes.
- The tool is not the brain.Answers are only as good as the model you pick. Ours handles questions about our own data well, and we still pay for bigger AI tools for design and writing.
- Some models think out loud.Ours reasons at length before answering unless told not to. For a short chat we switched that off, with think set to false in Ollama's own chat address.
Where the figures come from
- OllamaPricing opened November 4, 2026Running locally is in the $0 column. The cloud plans are the paid part.
- OllamaThe license, on GitHub opened November 4, 2026MIT.
- Digital Real EstateOur own timing November 4, 2026Run on the machine above through Ollama's chat address, with the two questions timed by a small script.
More labels
Published November 4, 2026. Prices and plans change, so check before you buy.