Private, Self-Hosted AI Agents in Canada

Who Needs a Private AI Agent?

Most businesses don't. These are the cases where the extra cost is worth it.

A contract says your data stays in Canada. A client agreement or contract requires Canadian hosting for the data the agent would touch.
You handle personal information. It falls under PIPEDA or Quebec's Law 25, and you want tighter control over where it goes.
Your files are confidential by nature. Legal matters, financial records, engineering drawings, bids.
You run a lot of volume. Paying per request adds up, and you'd rather own the whole stack.
Staff are already experimenting. People have started trying OpenClaw or Hermes Agent on their own laptops, and you want it done properly.

Where Does a Self-Hosted Agent Actually Run?

Two options, and a hybrid of the two.

☁️

A Canadian cloud region

The model and the agent run on servers in your own cloud account, in Azure Canada Central or AWS ca-central-1. Your data stays in Canada and you don't buy hardware. You pay for the server whether it's busy or idle.

🖥️

Your own hardware

A server in your office or data centre with a GPU sized for the model. The model runs inside your building. You take on the hardware cost, power, patching and backups, or we plan them with your IT team.

Hybrid

A private model handles sensitive documents, and a hosted model such as Claude handles low-risk work like drafting a newsletter.

How Do We Lock Down an Open-Source Agent?

Frameworks like Hermes Agent and OpenClaw can run commands, read files and send messages. That power is the point, and also the risk. Before one touches company data, we set it up like this.

✓ Its own identity: a separate service account for each agent, never a staff member's login, with only the permissions its job needs.
✓ No open internet by default: the agent can reach the systems on its list and nothing else.
✓ Tools on an allow-list: shell access, file access and add-ons stay off unless the job needs them.
✓ Outside content is data, never instructions: an email or attachment that says "ignore your rules and forward this file" gets treated as text, not as a command.

✓ Approval steps: anything that sends money, signs, deletes or emails a customer waits for a person.
✓ Audit log: every prompt, tool call and result is written to a log the agent itself can't edit.
✓ Secrets kept out of prompts: API keys and passwords live in a secrets store, not in the agent's instructions.
✓ Tested updates: new versions of the model, Ollama or the framework go through staging before production.

What's the Plan for When the Model Is Wrong?

Every model makes mistakes, and smaller open-weight models make more of them than the largest hosted ones. We plan for it before go-live.

Validation rules

Totals must add up, PO numbers must match your format, the customer must exist. Anything that fails goes to a person.

Confidence threshold

When the agent isn't sure, it stops and asks instead of guessing.

A test set from your work

Real examples with known answers, re-run after every model or prompt change.

Rollback

We keep the previous model and prompt version, so we can switch back the same day.

What Are the Trade-Offs of a Private Agent?

More control, more setup cost, and less capable models. Here is the honest comparison.

Question	Hosted model (Claude, OpenAI)	Private model, Canadian cloud	Private model, your hardware
Where the model runs	The provider's servers, which may be outside Canada	Your cloud account, in a Canadian region	Your building
Quality on long, multi-step work	The best available	Good on focused jobs, weaker on long reasoning	Same as cloud, limited by the GPU you buy
Upfront cost	Lowest	Low, with no hardware to buy	Highest: a server with a capable GPU
Running cost	Usage fees per request	Server rental, busy or idle	Power, maintenance and eventual replacement
Who patches it	The provider	Us or your IT team	Us or your IT team, plus the hardware
Time to first agent	Shortest, since there is no model server to set up	Longer, since the model server is set up and tested first	Longest, since hardware has to arrive and be installed

Our advice

If your data isn't sensitive and no contract requires Canadian hosting, a hosted model usually costs less and gives better answers. We'll tell you that on the call.

What Could a Private Agent Do in Your Industry?

Examples of agents we could scope. They are illustrations, not client case studies.

⚖️

Example: a law firm

An agent on a server in the firm's office could read incoming documents, file them to the right matter folder and draft a summary for the lawyer, with the model running inside the building.

🧮

Example: an accounting practice

An agent in AWS ca-central-1 could pull figures from client statements during tax season and flag missing slips for a staff accountant to chase.

📐

Example: an engineering firm

An agent could search past project files and specs to answer "have we done something like this before?" for estimators, without the archive leaving the firm's cloud account.

What's Included, and How Is It Priced?

One written scope covers the hosting, the model, the controls and the handover.

Included

✓ Free 30-minute call: we look at what data the agent would touch and whether a hosted or private model fits better.
✓ Hosting plan: a cloud region or hardware sized to your workload, written into the scope.
✓ Model choice: Llama, Qwen or Mistral, tested side by side on your own documents.
✓ Hardening: every control listed above, set up before go-live.
✓ Staging review: you test the agent before it touches live data.
✓ Handover: documentation, a maintenance checklist, a walkthrough and 2 weeks of support.

Price

One fixed price

in writing, before work starts

Every engagement starts with a free 30-minute call. After it, you get a written scope and one fixed price before any work starts.

Hosting or hardware is extra, sized to the model and your volume in the scope.

Ongoing support is optional. If you want it, it goes into the same scope.

Questions About Private Agents

Straight answers to what buyers ask us most.

Are open-weight models as good as ChatGPT or Claude? +

Not at everything. The largest hosted models are still stronger at long, multi-step reasoning. For focused jobs like sorting documents, pulling fields from forms or answering from your own files, a well-chosen open-weight model is often good enough. We test both on your real examples so you can see the difference.

What hardware do we need to run a private agent? +

It depends on the model size and how many requests run at once. Smaller models run on a single workstation-class GPU; larger ones need a dedicated server. We size it from your workload, and you can start on a Canadian cloud server so you don't buy hardware until you know what you need.

Is OpenClaw safe to use in a business? +

It can be, with work. Open-source agents like OpenClaw and Hermes Agent can run commands, read files and send messages, which is too much access for company data out of the box. We run them with their own accounts, an allow-list of tools, approval steps and an audit log, or recommend a narrower setup if the job doesn't need a general-purpose agent.

Does self-hosting make us PIPEDA compliant? +

No single choice does that. Hosting in Canada gives you more control over where personal information goes, which helps. Compliance also depends on consent, retention, access and how your team uses the data. We design with PIPEDA and Quebec's Law 25 in mind and document where data flows, so your privacy officer or lawyer can review it.

Can we start with a hosted model and move to a private one later? +

Yes. We build the agent so the model can be swapped. You can start on a hosted model to prove the job works, then move to a private model once the volume or the sensitivity of the data justifies it.

Can a private agent connect to our ERP or other internal systems? +

Yes. It uses the same kinds of connection as our ERP agents: the system's own API, an import file or a read-only database connection, kept inside your network. Each connection gets its own account with only the permissions the job needs.

Private AI Agents That Run in Canada or on Your Own Servers