Where does your customers' data go when you use AI? Running Ollama on your own computer
When you paste a customer's email into an AI chat, where does that email actually go? It is a fair question for any business that handles client letters, quotes or invoices. One answer is to run the AI on your own computer instead of someone else's servers. A tool called Ollama lets you do exactly that, and its own documentation is specific about what that means for your data.
What stays on your computer
Ollama's documentation says that Ollama runs locally, and that when you run it locally, Ollama does not see your prompts or your data. For a small business, that is the headline: if the model runs on your own machine, the text you give it does not have to travel anywhere to be processed.
What does not stay local
Ollama also offers cloud models and web search. The documentation is clear that these are different: when you use cloud-hosted models, Ollama processes your prompts and responses to provide the service. Ollama says it does not store or log that content and never trains on it. That is a reasonable promise, but it is a promise about a service, not the same thing as keeping everything on your own machine.
How to keep it strictly local
Ollama can run in a local-only mode by switching its cloud features off. The documentation notes the trade-off: with the cloud features off, you lose the ability to use Ollama's cloud models and web search. If your priority is that client information never leaves the building, that trade is likely worth making.
One default worth knowing
By default, Ollama listens only on your own machine. The documentation explains that this can be changed with a setting, so it is worth checking that nobody on your team has changed it before you put anything sensitive through it.
A simple way to start
Imagine a small accounting practice, purely as an illustration and not as a real case. Client letters and draft invoices could be worked on locally, with the cloud features switched off, so that nothing is sent to an outside service. Before you paste anything private into any AI tool, check which mode you are in: local, or cloud.
Want AI working for your business? Contact LIID Digital today for advice, a custom build, or a free demo.