LangSmith vs Sentry
LLM observability, testing & evaluation — by LangChain
vs. Application monitoring, error tracking, tracing, session replay
Pricing tiers
LangSmith
Developer (Free)
Free forever. 5,000 traces/month. 14-day retention. 1 seat. Basic evaluations.
Free
Plus
$39/seat/month. 10k base traces included ($2.50 per 1k overage). Full evaluations, custom dashboards, email support.
$39/mo
Enterprise
Custom. Self-host option, SSO, custom retention, dedicated support.
Custom
Sentry
Developer (Free)
Single user. 5k errors + 5M spans + 5GB logs + 50 replays + 1GB attachments per month.
Free
Self-Hosted (OSS)
BSL-licensed. Docker-based deploy. Free for personal/internal, commercial requires license.
$0 base (usage-based)
Team
$26/mo annual ($29/mo). Unlimited users. 50k errors/mo. 20 custom dashboards. Third-party integrations.
$26/mo
Business
$80/mo annual. 90-day insights lookback, unlimited dashboards, anomaly-detection alerts, SAML + SCIM.
$80/mo
Enterprise
Custom. Dedicated TAM, premium support, single-tenant option.
Custom
Free-tier quotas head-to-head
Comparing developer on LangSmith vs self-hosted on Sentry.
| Metric | LangSmith | Sentry |
|---|---|---|
| No overlapping quota metrics for these tiers. | ||
Features
LangSmith · 14 features
- Alerts — Threshold alerts on latency, cost, eval metrics.
- Annotation Queues — Human-review workflows for trace quality rating.
- Custom Dashboards — Aggregate metrics dashboards per project/tag.
- Datasets — Collect examples → use as eval sets or training data.
- Evaluations — LLM-as-judge, embedding similarity, custom Python evaluators, offline batch eval…
- LangChain Integration — Auto-trace any LangChain/LangGraph run with env var.
- LangGraph Integration — First-class trace + eval for LangGraph agents.
- LLM Tracing — Automatic trace every LLM call + tool call + chain step.
- OpenTelemetry Export — Export traces as OTLP to Datadog/Honeycomb/etc.
- Playground — Test prompts + models inline before deploying.
- Prompt Canvas — Visual prompt editor with live test + eval.
- Prompt Hub — Public + private prompt library with versioning.
- Self-Hosted (Enterprise) — Docker + k8s deployment in your infra.
- Threads + Sessions — Group traces into conversational sessions.
Sentry · 16 features
- Alerts — Metric + issue-based alerts routed to Slack/PagerDuty/email/etc.
- Cron Monitoring — Check-in pings for scheduled jobs. Alert on missed/failed runs.
- Distributed Tracing — Performance monitoring spans across services. Connect frontend → backend → DB.
- Error Tracking — Capture exceptions with stack traces, breadcrumbs, tags, release info, user cont…
- Insights — Pre-built dashboards per domain: Frontend, Backend, Mobile, AI, Database, LLM, e…
- LLM Monitoring — Track OpenAI/Anthropic/etc calls, token usage, cost, errors.
- Logs — Centralized structured logging correlated with errors + traces.
- Profiling — CPU profiling for Python, Node.js, Go, PHP, Ruby, Android, iOS.
- Release Health — Adoption + crash-free rate per release version.
- Releases — Track deploys, commit hooks, source map upload, bisect.
- Seer (AI Debug) — Root cause analysis + fix suggestions for issues via AI.
- Self-Hosting — Docker-based self-host. Feature parity.
- Session Replay — Record DOM + network to replay user sessions that hit errors.
- Source Maps — Auto-symbolicate minified code. Upload via CLI or Webpack/Vite plugin.
- Uptime Monitoring — Synthetic checks for HTTP endpoints.
- User Feedback — In-app feedback widget tied to sessions.
Developer interfaces
| Kind | LangSmith | Sentry |
|---|---|---|
| CLI | LangSmith CLI | Sentry CLI |
| SDK | langsmith-js, langsmith-python | sentry-android, @sentry/browser, sentry-cocoa (iOS), sentry-dotnet, sentry_flutter, sentry-go, sentry-java, @sentry/node, sentry-php, @sentry/react-native, sentry-ruby, sentry-sdk (Python), sentry-unity |
| REST | LangSmith REST API | Sentry REST API |
| MCP | LangSmith MCP | Sentry MCP |
| OTHER | LangSmith Dashboard | Webhooks (Alerts) |
Staxly is an independent catalog of developer platforms. Outbound links to LangSmith and Sentry are plain references to their official websites. Pricing is verified against vendor pages at publication time — reconfirm before buying.
Want this comparison in your AI agent's context? Install the free Staxly MCP server.