Skip to main content

32 docs tagged with "operations"

View all tags

API service operations

TelAPI Fastify HTTP/WebSocket API behind a managed load balancer — operations, runbook, configuration, troubleshooting.

Application and call-flow logging

What TelSys, TelPro, and RTPEngine log during a call, how log levels are used, and how to correlate application logs with SIP signaling.

Call Detail Records (CDR)

One summary log record per call — timing, bot context, provider identifiers, latency, error/fallback, and correlation IDs — queryable in SigNoz and persisted to AppLog.

Call lifecycle (Stasis)

How a call enters Asterisk Stasis, how TelPhi drives it from StasisStart to teardown, and how the max-call-duration limit is armed and enforced.

Configuration backup and rollback

Back up and restore Delphi deployment configuration across bootstrap env, generated config bundles, AWS SSM, Secrets Manager, and Postgres-backed settings.

Database credentials

Migration vs runtime Postgres users — MIGRATION_DATABASE_URL for schema work, DATABASE_URL for application CRUD, and optional DATABASE_SECRET_ARN for day-2 rotation.

Database service operations

PostgreSQL 17, Redis 7, and PgBouncer with attached block storage — operations, runbook, configuration, troubleshooting.

For platform operators

Operator-side symptoms — container, network, secret, migration — with pointers into the canonical per-service runbooks.

init.sh and update.sh

The two scripts every service uses — init.sh brings the service up from a clean shell, update.sh wraps it with backups and confirmation for steady-state operations.

Load testing

How Delphi expects SIPp / Vodafone load tests to be run, certified single-voice capacity, and STT/TTS WebSocket resilience under load.

Media service operations

Private HTTPS TTS media cache (Caddy + media-upload) at static private IP 10.0.1.30 — operations, runbook, configuration, troubleshooting.

Monitoring in SigNoz

How Delphi services send logs, traces, metrics, health signals, and call debugging data through OTel collectors into SigNoz.

Operations

Per-service operations index — purpose, runtime, ports, dependencies, and links to each service's operations page.

Ops service operations

Scaler and Tasker — autoscaling, background jobs, cron, DB backups, and email notifications.

Recovery recipes

Operator playbooks for restoring a broken Delphi environment. Conservative defaults, clear "stop and ask" points, and links to the canonical runbooks.

Redeploy a service

Re-run init / update on a Delphi service host cleanly, including the case where the previous update failed mid-way (partial migration, half-pulled image, half-applied config).

Replay stuck jobs

When the Ops service is up but a queue has stalled — diagnose, drain, and re-enqueue safely.

Restart matrix

Which Delphi services must be restarted after image, config, SSM, Secrets Manager, TLS, and database changes.

S3 recording output

Reference for the S3 objects Delphi stores for a recorded conversation, including audio tracks, transcripts, turn artefacts, and temporary source files.

Service logs

What each Delphi service logs, where the logs land (SigNoz via OTLP and stdout filelog), and the full TelWeb and TelPhi log inventories — server-side structured logs, call/telephony events, CDR, AI/DB spans, audit/auth events, route-handler logs, and client-side console output.

SigNoz service operations

SigNoz observability backend on static private IP 10.0.1.10 — Foundry deploy, version upgrades, legacy migration, alert sync, and troubleshooting.

SIP signaling reference

What Kamailio and TelSys log for SIP — capture points, methods (OPTIONS, CANCEL, PRACK), response codes (481, 487), and how records reach the Debug SIP ladder.

SIP trunk log reference

Catalog of SIP trunk health logs emitted by TelPhi and TelAPI — when each fires, what it means, and which payload fields appear.

Squid service operations

HTTP/HTTPS proxy for private-network instances — operations, runbook, configuration, troubleshooting.

TelPro service operations

SIP proxy (Kamailio), media proxy (RTPEngine), WebRTC gateway (Janus), and TURN server — operations, runbook, configuration, troubleshooting.

Trace debug search

How super-admins search retained SigNoz telemetry by trace ID, call ID, or SIP header value from the TelWeb Trace Debug view — friendly header mode and raw ClickHouse SQL mode.

Transaction correlation

How the TOBi transactionId propagates from the managed LLM provider through TelAPI, Redis, Kamailio, TelSys, and OTel spans so every event in a conversation can be correlated under one stable id.

Voice service operations

Asterisk (TelSys) plus the AI conversation engine (TelPhi) — operations, runbook, configuration, troubleshooting.

Web service operations

TelWeb management dashboard behind Caddy — operations, runbook, configuration, and troubleshooting.