Deployment and operations, answered in full.
- Questions in this subject
- 7
- Questions across the whole set
- 54
- Subject, in the reading order
- 3/7
Each answer stands on its own
Open a question for the answer, its limits and links to the detail.
What does Token Observe need to run?
A customer-hosted Token Observe installation needs one Node.js 24 process, or the published container image, and one configured database (normally a single SQLite file in WAL mode) holding the entire persistent state. There is no second datastore, cache tier, object store or message broker, so backing up that one file backs up the durable state. Terminate TLS in front of it: Token Observe speaks plain HTTP behind your proxy and manages no certificates, and at rest the database is encrypted by whatever your volume or host provides rather than by the product. Your reverse proxy must not buffer responses, or server-sent event streaming breaks; it must preserve the Authorization and x-api-key headers, set the forwarded headers, and allow a read timeout longer than your longest expected model response. The reference Compose file publishes on loopback rather than every interface, deliberately: the dashboard, the API and an unauthenticated Prometheus endpoint carrying agent identifiers and month-to-date spend share that listener.
How long does it take to get one agent governed?
For customer hosting, the onboarding guide plans about an hour for a first governed agent in a persistent installation from the full source distribution. This is a walkthrough estimate, not a measured onboarding result. Roughly twenty minutes cover the mechanical steps: install, boot, run the quickstart, mint a key, change one base URL, watch the first trace appear. Allow time for two decisions with your team: who owns the agent and what it is for, then which policy you are ready to enforce. The recommended order is to start every policy in shadow mode so the first day produces findings instead of outages, then promote to enforce once you know the false-positive rate. The install reports its own configuration through a readiness endpoint computed from live state rather than a setup flag, so it goes red again the day someone rotates a provider credential out of the environment.
Does Token Observe support high availability?
No. The cloud pilot runs one replica with a parent process supervising separate workspace children and has no availability SLA. A customer-hosted runtime supports exactly one active process on one node in this release, whichever store is configured, and there is no replica, no clustering and no vendor-operated uptime SLA. SQLite is single-writer by design at this scale; under sustained heavy write load the bottleneck is trace-event insertion rather than the governance decision, and two instances must never point at one SQLite file. PostgreSQL is implemented and exercised in CI against a dual-backend contract, but a passing CI run proves adapter compatibility, not a production deployment, multi-replica safety, point-in-time recovery or a timed restore; the onboarding technical-readiness check deliberately keeps reporting not ready while a database URL is set. Several controls are also process-local: the login throttle, connector token buckets, identity-provider transactions, provider circuit state and upstream MCP sessions. Multiplying processes would multiply the throttle allowance. Keep workloads whose outage would harm customers outside this release.
How do we back up and restore?
For customer hosting, Token Observe’s persistent state is one runtime database file, so back it up like evidence rather than like a cache. The shipped command takes a consistent snapshot against a live database, then reopens the artifact, runs an integrity check, walks every audit row and keyed checkpoint, captures that artifact’s exact head, and fsyncs the file and its manifest before publishing them; copying a live WAL database instead produces a plausible stale one. Record the four values the backup prints (sequence, audit hash, file digest and snapshot-descriptor digest) somewhere this deployment does not control, because that external tuple is what a restore is checked against. A restore also needs the ordered audit key ring injected, not just the file. Two limits: this is full-snapshot recovery and not point-in-time recovery, and there is no scheduled backup job, retention enforcement or freshness alarm; the three-copy policy is yours to run and monitor.
How do upgrades and rollbacks work?
Token Observe’s migrations are additive and backward-compatible, so you deploy the new code first and contract in a later release, and /readyz reports unready until migrations have applied; use it as the gate so traffic never reaches a half-migrated process. An ordinary one-release rollback works while no effect-required tool pin has ever been activated. After activation it does not, because an older binary does not understand the effect state machine and could dispatch that tool without it. The documented emergency path is a drained maintenance window: quarantine every effect-required pin using its already-reviewed descriptor hash, verify the catalogue reports each one quarantined, stop every process, then deploy the older image, keeping the pins quarantined until the fleet is effect-aware again. Rolling back two releases is not tested. If you cannot complete and verify that ceremony, preserve the database and escalate instead.
How many agents and how much traffic can one deployment take?
Token Observe offers no capacity commitment for a single deployment, because no measurement on partner-shaped data supports one yet. The documented envelope is roughly five to fifty API-key agents owned by one team, one or two model providers and a bounded set of pinned MCP tools. What the process does have is an admission ceiling: in-flight requests default to 256, and beyond it new work receives 503 ACP_OVERLOADED with a Retry-After while health, readiness and metrics probes stay reachable. Storage grew at roughly 3.1 KB per completed request under the laboratory mix. That laboratory baseline is the only published performance figure and it travels with its own conditions in the latency answer rather than being restated here; two of the six caveats on it are about capacity specifically — the request mix was a narrow deterministic one rather than yours, and the run was not the release container — and the source document’s closing instruction is not to turn it into a concurrency limit or a throughput commitment until a partner-shaped test has passed against agreed error, latency, storage and recovery thresholds. The soak harness that would close that gap ships; its evidence does not. It runs only the compiled artefact on loopback against a fresh temporary database and the in-process mock provider, supplies all of its own settings so live configuration cannot leak into the child process, and has no deployment-URL option at all. Duration is mandatory and bounded from one minute to twenty-four hours; the request mix is deterministic at 60 per cent allowed model calls, 20 per cent policy blocks, 10 per cent approval journeys and 10 per cent authenticated reads; and the defaults fail the run below 95 per cent of planned journeys, above 1 per cent unexpected outcomes, 0.1 per cent unexpected refusals, 1,000 ms at the 95th percentile, 2,000 ms at the 99th, 256 MiB of memory growth, 32 KiB of database growth per attempt, or 2.5 times latency degradation. Missing samples, early exit and interruption all fail closed. The harness closes the automation gap and does not retroactively close the evidence gap, and no completed multi-hour result is asserted.
Can Token Observe run air-gapped?
Yes. The customer-hosted version of Token Observe runs air-gapped, and the licence grants that explicitly alongside your own data centres and cloud accounts. The delivered image runs fully offline: the dashboard bundles no CDN assets, and beyond the providers, tool servers, webhook receivers, identity provider and anchor sink you configured there are exactly two other outbound paths. One is an admin-invoked lookup of the public OpenRouter price catalogue, which sends no prompt, trace or identifier; air-gapped installs never call it and post prices in instead. The other is the two shipped vendor pull connectors (GitHub Copilot seat spend and Cisco Umbrella DNS and proxy activity), whose hosts are fixed on the connector definition rather than named by you, and which open no socket until the connector scheduler is enabled and the credentials are set; an air-gapped install supplies neither, so neither ever runs. Egress is allowlisted rather than merely configurable, so a network policy permitting outbound connections only to your model providers, your tool servers and your webhook receivers leaves the product fully functional — adding your identity provider and your anchor sink only if you enabled those. One caveat belongs beside that claim: running the delivered image air-gapped is a different thing from building it from source, which still needs access to the base image, the Debian archives and the npm registry.
Before a pilot, review the residual risks and the role that must accept each one in writing.
Read the residual risks- OpenAIChat Completions, Responses and embeddings
- AnthropicMessages, including the x-api-key dialect
- Google GeminiNative Gemini ingress
- OpenRouterWith caller-controlled route selectors refused before egress
- Amazon BedrockFor estates that will not egress to a model vendor directly
- Azure OpenAIDeployment-name routing under the same policies
- Your own endpointAny OpenAI-compatible endpoint you host
Cloud setup offers OpenAI, Anthropic, xAI and Google. Use separate billing and inference credentials.
54 questions, in 7 subjects
What Token Observe is
What the product does, who it suits, its current stage, that it has no reference customers yet, and the limits of a pilot.
12 questionsLicence, pricing and support
The source-available licence, how the product is metered, the free 30-day trial, the support model, what procurement needs on data processing, and how your records leave if you stop.
6 questionsSecurity and threat model
The threat model, key custody, injection and redaction limits, whether the audit log can be rewritten, vulnerability disclosure, and what has not been tested.
10 questionsCompliance and evidence
EU AI Act, ISO/IEC 42001, NIST AI RMF and OWASP mappings, what an evidence export proves, retention and erasure, and which certifications do not exist.
6 questionsHow it works
The request path step by step: how an agent is onboarded, what happens inline, what streaming and failover do, what happens when something is unavailable, and what you do when a policy blocks work it should not have.
8 questionsAlternatives and adjacent tools
Where Token Observe sits against gateways, observability, security platforms and identity products, and the case for and against building it yourself.
5 questionsTry it free for 30 days.
Create a cloud account and workspace. No card or server installation. Model calls and Google BigQuery scans can incur separate provider charges.