Technology · Agentic → Observability · Open Core · wiki:deep
Helicone
Helicone is an AI gateway and LLM observability platform: point OpenAI-compatible clients at Helicone’s gateway for logging, cost/latency, sessions/traces, prompt management, playground, and routing/fallbacks across many models — often with a one-line baseURL change. It also supports async OpenLLMetry-style logging and framework integrations (LangChain, Vercel AI SDK, and others). Open-source (Apache-2.0) with self-host (Docker/Helm) and cloud; SOC2/GDPR claims for enterprise. YC W23.
Why it matters here
Fastest path to request-level LLM logs without deep span instrumentation. Prefer Helicone for gateway/proxy adoption; prefer Langfuse/Phoenix/Opik for richer agent-tree debugging and eval workflows; prefer OpenLLMetry to keep vendor-neutral OTEL into existing ops stacks.
How it works
Clients send completions through Helicone’s AI Gateway (or async OpenLLMetry logging). Helicone stores/analyzes requests; operators inspect sessions, costs, and prompts in the UI.
- Obtain API key (cloud) or self-host.
- Set client
baseURLto Helicone gateway (or async logger). - Call models as usual; view logs/dashboard.
- Optionally version prompts and export analytics.
Related: arize-phoenix · comet-optik · langfuse · topics/09-self-monitoring
Scroll inside the canvas to pan
When to reach for it
- Use when: you want minimal-code LLM request observability and/or multi-provider routing.
- Skip when: you need deep agent graph evals (langfuse, phoenix, comet-optik) or pure OTEL instrumentation (openllmetry).
- Prefer instead: OpenLLMetry if Datadog/Grafana already own backends.
Limits
- Proxy in the path: gateway outages/latency become your outages.
- Not case audit: request logs ≠ propose→gate→execute ledger.
- Self-host complexity: multi-service stack (web, worker, ClickHouse, Supabase, Minio).
- Does not replace IAM/policy gates.
Linked from
Catalog backlinks — what points here (wiki “what links here”).
Features
- cost-latency-ops
- observability-auditability
- r2-09-self-monitoring
- r2-14-process-mining
- r2-34-decision-lineage
- r2-38-abm-span-mapping
- r2-47-trace-maturity-gate
- wt-runtime
Stacks
Peers
What we checked
Claims below are backed by science sources on disk.
Gateway / observability role
Helicone/helicone · MODERATE
“Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23”
Docs / features
Helicone documentation · MODERATE
“Open source LLM observability platform. One line of code to monitor, evaluate, and experiment.”
Contrast vs Langfuse
Langfuse contrast · MODERATE
“One line of code to monitor, evaluate, and experiment.”
In this research stack
Features and peers linked from the catalog map — not a second product surface.
Features it supports
- cost-latency-ops
- observability-auditability
- r2-09-self-monitoring
- r2-14-process-mining
- r2-34-decision-lineage
- r2-38-abm-span-mapping
- r2-47-trace-maturity-gate
- wt-runtime
Same cell
Stack
Document management
No DM vendor crosswalk edges yet.
Source
Primary repo github.com/Helicone/helicone · Open Core
technologies/helicone/README.md
Research inventory
9 tags · 14 out · 15 in · 3 artifacts · 1 gaps · 30 corpus docs
Catalog tags
- landscape.layer
- Agentic
- landscape.subcategory
- Observability
- license_tag
- Open Core
- maps.dm
- absent
- maps.features
- 8
- one_liner
- Agentic
- review.depth
- science
- slug
- helicone
- title
- Helicone
Artifacts
- dm_map · absent
- features_map · present · technologies/helicone/features.md
- readme · present · technologies/helicone/README.md
Out · alternative_to
- arize-phoenixtechnology
- comet-optiktechnology
- langfusetechnology
- langsmithtechnology
- openllmetrytechnology
- wandb-weavetechnology
Out · maps_to
- cost-latency-opsfeature
- observability-auditabilityfeature
- r2-09-self-monitoringfeature
- r2-14-process-miningfeature
- r2-34-decision-lineagefeature
- r2-38-abm-span-mappingfeature
- r2-47-trace-maturity-gatefeature
- wt-runtimefeature
In · alternative_to
- arize-phoenixtechnology
- comet-optiktechnology
- langfusetechnology
- langsmithtechnology
- openllmetrytechnology
- wandb-weavetechnology
In · in_stack
- agentic-observabilitystack · alternative_slot
In · maps_to
- cost-latency-opsfeature
- observability-auditabilityfeature
- r2-09-self-monitoringfeature
- r2-14-process-miningfeature
- r2-34-decision-lineagefeature
- r2-38-abm-span-mappingfeature
- r2-47-trace-maturity-gatefeature
- wt-runtimefeature
Corpus tags
- category
- Agentic → Observability
- dedication
- open-core
- feature
- cost-latency-opsobservability-auditabilityr2-09-self-monitoringr2-14-process-miningr2-34-decision-lineager2-38-abm-span-mappingr2-47-trace-maturity-gatewt-runtime
- kind
- map_edgetech_featurestech_quotetech_readmetech_science_sourcetech_section
- needs_deepen
- false
- quality
- ok
- section
- EvidenceFeatures mapGitHub mapHow it worksLimits & failure modesLinksScientific notesWhat it isWhen to use / skipWhy it matters here
- slug
- helicone
- source_id
- helicone-docshelicone-githublangfuse-contrast
- technology
- helicone
Corpus documents (30)
map_edge · 8
- helicone → cost-latency-ops
- helicone → observability-auditability
- helicone → r2-09-self-monitoring
- helicone → r2-14-process-mining
- helicone → r2-34-decision-lineage
- helicone → r2-38-abm-span-mapping
- helicone → r2-47-trace-maturity-gate
- helicone → wt-runtime
tech_features · 1
- Helicone · features
tech_quote · 7
- Helicone · helicone-docs
- Helicone · helicone-docs
- Helicone · helicone-docs
- Helicone · helicone-github
- Helicone · helicone-github
- Helicone · langfuse-contrast
- Helicone · langfuse-contrast
tech_readme · 1
- Helicone
tech_science_source · 3
- Helicone · helicone-docs
- Helicone · helicone-github
- Helicone · langfuse-contrast
tech_section · 10
- Helicone · Evidence
- Helicone · Features map
- Helicone · GitHub map
- Helicone · How it works
- Helicone · Limits & failure modes
- Helicone · Links
- Helicone · Scientific notes
- Helicone · What it is
- … +2 more