Amazon CloudWatchby Amazon Web Services
Metrics, alarms, dashboards and log storage for resources running on AWS.
10 custom metrics + alarms
5 GB log ingestion, 1M API requests
APM and metrics
31 services
APM and metrics tools collect performance data from servers, containers and application code: request traces, CPU and memory, slow queries and custom metrics. General platforms such as Datadog, New Relic and Grafana Cloud cover most stacks, while narrower tools target one runtime, like Skylight and DeadBro for Rails. A newer group, including Langfuse, Arize AX and Portkey, traces LLM calls, token use and cost.
31 services
Visit
Arize AXarize.com
Tracing and evaluation platform for LLM apps and agents, with self-hosted Phoenix option.
- No card
25,000 spans/mo
1 GB ingestion/mo, 15-day retention, Unlimited users
bleemeo.combleemeo.com
Server and container metrics with uptime checks, dashboards and alert rules.
3 servers
5 uptime monitors, Unlimited users
Datadogdatadoghq.com
Infrastructure metrics, APM and observability platform with many integrations.
5 hosts
DeadBrodeadbro.com
Performance monitoring for Rails: traces, slow queries, N+1 detection and errors.
- No card
50,000 requests/mo
1 app, 7 days retention, 1 uptime check
Embraceembrace.io
Mobile app performance and crash monitoring by user session.
1M sessions/yr
5 servers
60-sec interval
Future AGIfutureagi.com
Open-source evals, tracing, agent simulation and guardrails for LLM apps.
- Open source
100,000 gateway requests/mo
50 GB storage, 2,000 eval credits, Unlimited seats
Grafana Cloudgrafana.com
Hosted Grafana with Prometheus metrics and Loki logs for dashboards and alerting.
10,000 metric series
50 GB logs, 3 users, 10 dashboards, 14 days retention
Keywords AIkeywordsai.co
LLM gateway with monitoring that routes calls to hundreds of models through one API.
10,000 requests/mo
Langfuselangfuse.com
Open-source tracing, prompt management and evals for debugging LLM applications.
- Open source
50,000 observations/mo
LangWatchlangwatch.ai
LLMOps monitoring and evaluation with DSPy-based prompt optimization.
- Open source
1,000 traces/mo
1 DSPy workflow
Latitudelatitude.so
MIT-licensed tracing and evaluation for AI agents running in production.
- Open source
20,000 credits/mo
30-day retention, Unlimited seats
Middleware.iomiddleware.io
Observability platform covering logs, infrastructure metrics and APM.
1M log events
2 hosts for infra and APM
Monitorablemonitorable.io
Linux host monitoring for Docker, systemd units and SMART disks, using an OpenTelemetry agent.
- No card
3 servers
New Relicnewrelic.com
Full-stack observability with APM, infrastructure, logs and tracing in one platform.
100 GB ingest/mo
1 full-access user, Unlimited basic users
OpenObserveopenobserve.ai
Observability platform for logs, with hosted ingestion and querying.
200 GB ingestion/mo
15 days retention
Portkeyportkey.ai
AI gateway with request logging and observability for generative AI apps.
10,000 requests/mo
robusta.devhome.robusta.dev
Kubernetes monitoring on Prometheus, alerting to Slack, Teams, Discord and paging tools.
20 Kubernetes nodes
Simple Observabilitysimpleobservability.com
Server metrics and logs in one dashboard with minimal setup.
1 server
skylight.ioskylight.io
Performance profiler for Ruby on Rails apps.
100,000 requests
superlog.shsuperlog.sh
OpenTelemetry backend storing spans, logs and metrics; an AI agent helps investigate incidents.
- No card
- Open source
1M spans/mo
5M logs/mo, 10M metric points/mo, 30 days retention
SweetUptimedicloud.net
Monitoring for servers, website uptime, DNS records and domain expiry.
10 servers
10 uptime monitors, 10 domains
telemetry.devtelemetry.dev
OpenTelemetry tracing for LLM apps recording tokens, cost, latency and tool calls.
- No card
10,000 spans/mo
7-day retention, 1 project, 2 seats
Treblletreblle.com
API observability with request logging, generated docs, debugging and governance.
250,000 requests/mo
All features included
Xitoring.comxitoring.com
Uptime checks plus server metrics for Linux and Windows hosts, status pages and a mobile app.
20 uptime monitors
5 servers, 1 status page
Comet Opikcomet.com
Open-source tool for tracing, testing and evaluating LLM applications.
- Open source
Limits not listed
Limits not listed
inspector.devinspector.dev
Application monitoring dashboard showing live code execution and performance.
Limits not listed
Netdatanetdata.cloud
Real-time metrics collection agent for servers and apps, with a cloud dashboard.
- Open source
Limits not listed
Limits not listed