{ "company": "AgentOps", "slug": "agentops", "website": "https://www.agentops.ai", "audit_date": "2026-04-12", "overall_score": 32, "tier": "Agent-Invisible", "tier_as_published": "A", "pillars": { "P1": { "name": "Signal Architecture", "score": 11, "max": 25 }, "P2": { "name": "Clarity Stack", "score": 7, "max": 25 }, "P3": { "name": "Trust Envelope", "score": 4, "max": 20 }, "P4": { "name": "Velocity Triggers", "score": 6, "max": 10 }, "P5": { "name": "Gravity Design", "score": 4, "max": 20 } }, "criteria": [ { "id": "P1-A", "pillar": "P1", "name": "Structured Data", "score": 0, "max": 5, "evidence": "No evidence of schema.org markup, JSON-LD, or Organization/Offer schema on agentops.ai. Homepage is a standard React/Next.js marketing site with no detectable structured data in search result snippets or web search structured data queries." }, { "id": "P1-B", "pillar": "P1", "name": "Machine-Readable Pricing", "score": 1, "max": 5, "evidence": "Pricing tiers (Free: ~50K events/mo, Pro: ~$40\u201349/mo, Enterprise: custom) are mentioned on the homepage, but the dedicated /pricing page returns a 404 error. No schema.org Offer markup or clean JSON pricing structure detected. Pricing numbers inconsistent across sources (5K vs 50K events on free tier)." }, { "id": "P1-C", "pillar": "P1", "name": "llms.txt / Agent Layer", "score": 4, "max": 5, "evidence": "A docs index file exists at `docs.agentops.ai/llms.txt`, which is explicitly referenced in their documentation as a structured index for LLM/agent discovery of available pages and integrations. This is a meaningful agent identity layer, though it is docs-scoped rather than a product-level llms.txt at the root domain." }, { "id": "P1-D", "pillar": "P1", "name": "API / MCP Availability", "score": 3, "max": 5, "evidence": "Python SDK (`pip install agentops`) and TypeScript/JavaScript SDK available. MCP Docs Server is available for IDE integration (`npx mint-mcp add agentops`). Supports 25+ agent frameworks and 400+ LLMs. However, no OpenAPI spec was found; the API is SDK-first rather than REST-first, limiting direct agent programmatic consumption." }, { "id": "P1-E", "pillar": "P1", "name": "Discoverability (GEO)", "score": 3, "max": 5, "evidence": "Well-represented in AI developer directories (aiagentslist.com, aimultiple.com, etc.), ~4,000 GitHub stars, developer-focused blog, and strong integration with frameworks that AI agents are built on. Some SEO-quality content present, but no explicit AI retrieval optimization (no structured content for LLM answer engines)." }, { "id": "P2-A", "pillar": "P2", "name": "Offer Completeness", "score": 2, "max": 5, "evidence": "The \"what\" (agent observability/monitoring) and \"how much\" (tier pricing) are findable on the homepage, but the dedicated pricing page is broken (404). Pricing numbers are inconsistent across sources, making machine-parseable verification impossible without cross-referencing third-party review sites." }, { "id": "P2-B", "pillar": "P2", "name": "Scope & Limits", "score": 2, "max": 5, "evidence": "Event limits per tier are mentioned in marketing copy (Free: ~50K events/mo, Pro: ~500K events/mo), but these are stated in prose, not in a structured format. No explicit rate limits, API call caps, or SLA caps documented in discoverable form." }, { "id": "P2-C", "pillar": "P2", "name": "Substitution & Fallback Rules", "score": 0, "max": 5, "evidence": "No guidance found on what happens if the service is unavailable, no SLA fallback, no downtime compensation policy. No FAQ or documentation addressing service substitution or interruption." }, { "id": "P2-D", "pillar": "P2", "name": "Conditional Logic Transparency", "score": 1, "max": 5, "evidence": "Enterprise pricing requires \"contact sales\" with no disclosed conditions, minimums, or feature gates. Pro vs Free distinction exists but conditions for Enterprise access are fully opaque." }, { "id": "P2-E", "pillar": "P2", "name": "Semantic Precision", "score": 2, "max": 5, "evidence": "Technical language is often precise (\"Time Travel Debugging,\" \"point-in-time replay,\" \"token counting\") but marketing copy includes vague claims like \"leading developer platform\" and \"best-in-class reliability.\" Pricing inconsistency between sources (5K vs 50K free tier events) undermines semantic precision." }, { "id": "P3-A", "pillar": "P3", "name": "Verifiable Performance Data", "score": 1, "max": 5, "evidence": "No public status page accessible (status.agentops.ai returned connection refused). No third-party verified uptime data found. Enterprise logos cited (Microsoft, Google, Samsung, Meta, J&J, Accenture, Deloitte) but not independently verifiable via case studies or third-party reviews. G2 and Trustpilot listings not confirmed." }, { "id": "P3-B", "pillar": "P3", "name": "Scoped Permission Model", "score": 2, "max": 5, "evidence": "API key-based authentication with tier-based access (Free/Pro/Enterprise). No agent-scoped permissions found \u2014 no time-bounded, amount-bounded, or action-bounded access controls designed for autonomous agent evaluation and use." }, { "id": "P3-C", "pillar": "P3", "name": "Audit Trail / Transaction Log", "score": 1, "max": 5, "evidence": "Ironically, audit trail generation is AgentOps' core product feature \u2014 it creates audit trails FOR agents being monitored. However, there is no machine-accessible audit log for agents interacting WITH the AgentOps platform itself (i.e., no API endpoint logging agent API calls made to AgentOps)." }, { "id": "P3-D", "pillar": "P3", "name": "Behavioral Consistency Signals", "score": 0, "max": 5, "evidence": "No versioned terms of service found (/terms returned 404). No change notice policy. No documented stability track record or changelog for platform behavior. Open-source GitHub repo shows version history for the SDK, but the cloud platform has no visible versioning or change policy." }, { "id": "P4-A", "pillar": "P4", "name": "Friction-Free Activation", "score": 4, "max": 5, "evidence": "Activation is genuinely low-friction: `pip install agentops`, get an API key from the dashboard, add 2 lines of code. No sales call required for Free or Pro tiers. Sign-up appears to be self-serve. Loses 1 point because Enterprise tier requires human contact." }, { "id": "P4-B", "pillar": "P4", "name": "Agent Decision Signals", "score": 2, "max": 5, "evidence": "Free tier provides a programmatic trial signal, and cost tracking is a core platform feature (agents can observe their own costs via AgentOps). However, there are no explicit agent-legible signals for when to upgrade, what triggers tier changes, or programmatic cost-threshold notifications usable by an autonomous agent making purchasing decisions." }, { "id": "P5-A", "pillar": "P5", "name": "Integration Depth / Switching Cost", "score": 3, "max": 5, "evidence": "Deep integration with 25+ agent frameworks (CrewAI, LangChain, AutoGen, OpenAI Agents, Google ADK, etc.) creates meaningful switching friction. Historical session data, traces, and fine-tuning datasets accumulate over time and are not portable. However, AgentOps monitors agents rather than storing their operational data \u2014 agents could switch monitoring providers with relatively low operational disruption." }, { "id": "P5-B", "pillar": "P5", "name": "Agent Memory / Personalization Layer", "score": 0, "max": 5, "evidence": "AgentOps is a monitoring and observability platform, not a memory platform. No agent-accessible memory layer exists. Each session starts from scratch from the agent's perspective. Session data exists for human developers to review, not for agents to consume." }, { "id": "P5-C", "pillar": "P5", "name": "Programmatic Renewal Signals", "score": 0, "max": 5, "evidence": "No evidence of an agent-accessible renewal API, programmatic billing management, or automated tier upgrade mechanism. Standard SaaS billing through a human-facing dashboard." }, { "id": "P5-D", "pillar": "P5", "name": "Compounding Value Signal", "score": 1, "max": 5, "evidence": "Historical session data and the ability to fine-tune specialized LLMs on saved completions represent latent compounding value. However, this value is accessible only to human developers, not readable by autonomous agents. No agent-facing signals of accumulated value over time." } ], "strongest_signals": [ { "title": "llms.txt exists at docs.agentops.ai/llms.txt", "detail": "\u2014 A structured LLM-readable documentation index is present, making AgentOps' docs discoverable and navigable by AI agents. This is ahead of most tools in the space." }, { "title": "Extremely low-friction activation", "detail": "\u2014 \"2 lines of code\" to integrate, pip install, instant API key, no sales gate for Free/Pro tiers. An AI agent could theoretically instruct a developer to integrate AgentOps with minimal steps." }, { "title": "MCP Docs Server available", "detail": "\u2014 `npx mint-mcp add agentops` gives IDEs and AI coding tools direct access to AgentOps documentation via MCP, signaling early awareness of agent-native distribution." } ], "critical_gaps": [ { "title": "Pricing page is broken (404)", "detail": "and pricing numbers are inconsistent across sources \u2014 a fundamental failure for any agent trying to evaluate or compare this offer. An AI agent cannot reliably determine what AgentOps costs." }, { "title": "No status page, no SLA, no terms of service", "detail": "\u2014 All three URLs returned errors. An AI agent making a vendor selection has zero verifiable trust signals. No uptime history, no commitment to reliability, no legal terms accessible." }, { "title": "No agent-scoped permissions or audit log", "detail": "\u2014 AgentOps monitors agents but is not built to be evaluated, purchased, or audited BY agents. The trust infrastructure needed for agent-to-vendor relationships is entirely absent." }, { "title": "Compounding value is human-visible only", "detail": "\u2014 The historical session data and fine-tuning capabilities that create long-term value are locked behind a human-facing dashboard, invisible to autonomous agents." } ], "priority_actions": [ { "action": "Fix and structure the pricing page", "points_gain": 6, "pillar": "P2", "effort": "Low" }, { "action": "Add schema.org Offer markup to pricing", "points_gain": 4, "pillar": "P1", "effort": "Low" }, { "action": "Publish a status page and SLA document", "points_gain": 5, "pillar": "P3", "effort": "Medium" }, { "action": "Create a root-level /llms.txt with product scope", "points_gain": 1, "pillar": "P1", "effort": "Low" }, { "action": "Add agent-scoped API permissions", "points_gain": 4, "pillar": "P3", "effort": "High" } ], "executive_summary": "AgentOps scores 32/100 (Agent-Invisible), landing in the lowest tier despite being a product genuinely built FOR AI agent ecosystems. The platform excels at low-friction activation \u2014 \"2 lines of code\" is as agent-friendly as developer tools get \u2014 and the presence of a docs llms.txt and MCP server shows early agent-native thinking. However, a broken pricing page, missing status page, absent terms of service, and no SLA mean that an AI agent performing autonomous vendor evaluation cannot verify what AgentOps costs, whether it's reliable, or what the contractual terms are. The deepest gap is an ironic one: AgentOps helps developers understand how their agents behave, but has not designed its own offer to be understood, evaluated, or trusted by agents. The highest-ROI fix is restoring and structuring the pricing page \u2014 a critical signal that currently scores zero for any agent trying to evaluate this tool.", "rubric_version": "v1-2026-04 (20 criteria, 100 raw points; P3-E Agent Registration added to rubric v2 in 2026-06, not scored in this audit)", "framework": "Agent Native Offers \u2014 The Agent Sale framework", "source_file": "2026-04-12 \u2014 AgentOps \u2014 Agent Native Offer Audit.md", "rank": 30 }