{ "company": "Portkey", "slug": "portkey", "website": "https://portkey.ai", "audit_date": "2026-04-14", "overall_score": 68, "tier": "Emerging", "tier_as_published": "E", "pillars": { "P1": { "name": "Signal Architecture", "score": 17, "max": 25 }, "P2": { "name": "Clarity Stack", "score": 17, "max": 25 }, "P3": { "name": "Trust Envelope", "score": 14, "max": 20 }, "P4": { "name": "Velocity Triggers", "score": 8, "max": 10 }, "P5": { "name": "Gravity Design", "score": 12, "max": 20 } }, "criteria": [ { "id": "P1-A", "pillar": "P1", "name": "Structured Data", "score": 1, "max": 5, "evidence": "No schema.org or JSON-LD markup found on portkey.ai homepage or pricing page. Web search for \"Portkey schema.org JSON-LD\" returned only generic schema.org guides with no Portkey-specific results. robots.txt is fully open (Allow: /) but there is no structured markup layer for agents to parse." }, { "id": "P1-B", "pillar": "P1", "name": "Machine-Readable Pricing", "score": 3, "max": 5, "evidence": "Pricing tiers at portkey.ai/pricing are clearly structured: Free (0, 10K logs/month), Production ($49/month, 100K logs, $9/100K overage up to 3M), Enterprise (custom). Feature comparison table is detailed and HTML-rendered. Not tagged as schema.org/Offer or PriceSpecification, but the data is parseable with moderate effort." }, { "id": "P1-C", "pillar": "P1", "name": "llms.txt / Agent Layer", "score": 4, "max": 5, "evidence": "docs/llms.txt exists and is referenced in the MCP Gateway documentation. The documentation index covers AI Gateway, Guardrails, Observability, Prompts, Governance, API Reference (Admin API, Inference API, Data Plane), SDKs (Python, Node.js, C#/.NET), 100+ LLM providers, agent framework integrations (CrewAI, LangGraph, OpenAI Agents), and a changelog spanning 2024\u20132026. Structured for LLM consumption. Minor deduction: lightweight llms.txt entry point at portkey.ai/llms.txt itself redirects rather than serving a clean file." }, { "id": "P1-D", "pillar": "P1", "name": "API / MCP Availability", "score": 5, "max": 5, "evidence": "Full REST API (OpenAI-compatible endpoint at api.portkey.ai/v1/chat/completions), Python SDK, Node.js SDK, C#/.NET SDK, Admin API. Official MCP Gateway at mcp.portkey.ai/{server-slug}/mcp with OAuth 2.1, API token, and JWT authentication. \"HTTP Streamable transport for all connections.\" Agent framework integrations (CrewAI, LangGraph, OpenAI Agents SDK, Claude Desktop, Cursor, VS Code). Open-source gateway with 10.2K GitHub stars processing 1T+ tokens/day." }, { "id": "P1-E", "pillar": "P1", "name": "Discoverability (GEO)", "score": 4, "max": 5, "evidence": "Listed on AWS Marketplace, G2 top-rated, 3,000+ GenAI teams using platform, cited in enterprise AI infrastructure comparisons. Documentation indexed by llms.txt. Open-source GitHub presence provides additional discoverability signal." }, { "id": "P2-A", "pillar": "P2", "name": "Offer Completeness", "score": 4, "max": 5, "evidence": "Single pricing page with numeric tier breakpoints: Free (0), Pro ($49/mo), Enterprise (custom). Feature comparison table maps every feature to tier. Overage pricing explicitly stated ($9/100K). What, who, and how much are all findable. Not fully machine-parseable due to HTML rendering, but very close." }, { "id": "P2-B", "pillar": "P2", "name": "Scope & Limits", "score": 4, "max": 5, "evidence": "Log limits per tier explicitly stated (10K/Free, 100K/Pro, 10M+/Enterprise). Overage policy documented. Budget limit policies configurable per team/workspace. Rate limiting per user available. Log retention periods stated: 3 days (Dev), 30 days (Pro), configurable (Enterprise). Clear, structured documentation." }, { "id": "P2-C", "pillar": "P2", "name": "Substitution Rules", "score": 3, "max": 5, "evidence": "Auto-fallback and retry logic are core documented features of the AI Gateway \u2014 described as built-in load balancing, fallbacks, and retries. These are agent-native substitution behaviors. However, they're framed as product features rather than explicit \"if unavailable, do X\" rules. Partial credit for native fallback infrastructure." }, { "id": "P2-D", "pillar": "P2", "name": "Conditional Logic Transparency", "score": 3, "max": 5, "evidence": "Tier boundaries clearly disclosed for Free/Pro. Enterprise requires \"custom pricing\" contact. SSO, VPC hosting, advanced compliance (SOC2, HIPAA) are Enterprise-only without thresholds disclosed. Conditions are documented across the feature comparison page but Enterprise gates are opaque." }, { "id": "P2-E", "pillar": "P2", "name": "Semantic Precision", "score": 3, "max": 5, "evidence": "Mix of precise and imprecise: \"99.99% uptime SLA,\" \"1T+ tokens/day,\" \"120M+ requests/day,\" \"3-line code integration,\" \"250+ LLMs,\" \"$180M+ annualized AI spend managed\" are precise. Claims like \"blazing fast\" and \"no-brainer\" appear in marketing copy. Overall better than average but not fully precise." }, { "id": "P3-A", "pillar": "P3", "name": "Verifiable Performance", "score": 4, "max": 5, "evidence": "Public status page at status.portkey.ai (307+ outage events tracked by StatusGator over past year, showing transparency). G2 top-rated with developer reviews. 99.99% uptime SLA published. SOC2 Type 2, ISO27001, GDPR, HIPAA compliance certifications. AWS Marketplace listing adds third-party validation. Deduction: status page shows real outage history including incidents, which is honest but shows service has had reliability events." }, { "id": "P3-B", "pillar": "P3", "name": "Scoped Permissions", "score": 4, "max": 5, "evidence": "Explicit multi-level RBAC: organization, workspace, team, and individual user levels. OAuth 2.1 with JWT validation and identity forwarding. Integration with Okta and Entra (enterprise identity providers). Rate limiting and budget policies per team. Fine-grained \"MCP Invoke permissions\" at key level. Close to 5 but no documented time-bounded or amount-bounded per-agent key scoping." }, { "id": "P3-C", "pillar": "P3", "name": "Audit Trail", "score": 3, "max": 5, "evidence": "Audit logs available at Enterprise tier. MCP Gateway logs every tool invocation (server, tool, inputs, outputs, latency, authorization status) in unified traces. OpenTelemetry export for traces. \"Configurable exports to data lakes\" at Enterprise. Deduction: audit logs not available below Enterprise tier; Pro users have 30-day log retention but it's described as observability, not a formal audit trail API." }, { "id": "P3-D", "pillar": "P3", "name": "Behavioral Consistency", "score": 3, "max": 5, "evidence": "Changelog spanning 2024\u20132026 documented in llms.txt index. Open-source gateway provides version control transparency (GitHub). API versioning present. No explicitly published notice period for breaking changes or version deprecation policy found." }, { "id": "P4-A", "pillar": "P4", "name": "Friction-Free Activation", "score": 5, "max": 5, "evidence": "Free developer tier (no credit card required per typical SaaS convention, though not explicitly confirmed), API key from dashboard, 3-line code integration (\"baseURL, api_key, x-portkey-provider header\"). Self-serve from free to Pro ($49/mo) without human gate. Open-source self-hosted option requires no account." }, { "id": "P4-B", "pillar": "P4", "name": "Agent Decision Signals", "score": 3, "max": 5, "evidence": "Free tier for trial. Clear price/log-count breakpoints signal upgrade triggers. Budget alerts configurable (agents can be set to notify at thresholds). No explicit \"agent-legible\" programmatic signal for when to act, upgrade, or initiate. Deduction for absence of a /status or /readiness endpoint agents can query to confirm service state before high-stakes requests." }, { "id": "P5-A", "pillar": "P5", "name": "Integration Depth", "score": 4, "max": 5, "evidence": "1,600+ LLM integrations, 250+ providers, 100+ guardrail partners, native integrations with CrewAI, LangGraph, OpenAI Agents SDK, LangChain, LlamaIndex, Langfuse, LangSmith. Prompt management with version history. Virtual keys for credential management. Switching means rebuilding routing logic, guardrail configs, prompt libraries, and virtual key mappings across all integrated providers. High real switching cost." }, { "id": "P5-B", "pillar": "P5", "name": "Agent Memory Layer", "score": 3, "max": 5, "evidence": "Account-level activity logs with custom metadata and filtering. Prompt version history accessible via API. Semantic caching retains and reuses prior responses. Feedback mechanisms for tracking agent output quality. Not a purpose-built \"agent memory\" layer but provides richer history than most competitors." }, { "id": "P5-C", "pillar": "P5", "name": "Programmatic Renewal", "score": 2, "max": 5, "evidence": "Auto-billing in place for Pro tier. No documented agent-accessible billing management API (check usage vs limit, trigger tier upgrade, adjust budget programmatically). Budget limit policies are configurable but require human setup in the dashboard initially." }, { "id": "P5-D", "pillar": "P5", "name": "Compounding Value Signal", "score": 3, "max": 5, "evidence": "Semantic caching compounds value over time as cached responses accumulate. FinOps + Executive Dashboard (Enterprise) shows cost optimization trends. Cost savings data surfaced in product (\"significant annual cost optimization\"). Not explicitly exposed via API metadata so agents can't read their own compounding value signal directly." } ], "strongest_signals": [ { "title": "MCP Gateway is a genuine agent infrastructure layer", "detail": "\u2014 Portkey's mcp.portkey.ai gateway with OAuth 2.1, RBAC, observability, and unified traces is one of the most complete agent-native trust layers in the market. The fact that every tool invocation is logged with identity, parameters, and latency makes this auditable at scale." }, { "title": "RBAC architecture built for agent teams", "detail": "\u2014 Four-level permission model (org/workspace/team/user) with identity provider integration and rate-limit policies per team. This is the right shape for enterprise agentic deployments where multiple agents must operate under different constraints." }, { "title": "Clarity Stack is strong", "detail": "\u2014 Clear numeric pricing, explicit log limits, overage pricing, and documented retention periods make Portkey's offer among the most parseable at the Pro tier and below." }, { "title": "Trust signals are verifiable", "detail": "\u2014 SOC2 Type 2 + ISO27001 + HIPAA + GDPR + public status page + G2 reviews + AWS Marketplace listing provide multiple independent trust verification points. This is rare at this tier." } ], "critical_gaps": [ { "title": "No schema.org structured data", "detail": "\u2014 Despite having a clear, well-structured offer, Portkey's homepage has zero machine-readable schema markup. Agents parsing the offer via web crawl must rely entirely on prose interpretation, which is an unnecessary friction point given how strong their underlying offer clarity is." }, { "title": "Audit trail locked to Enterprise", "detail": "\u2014 The most trust-critical feature for agent deployments (machine-accessible audit logs) is Enterprise-only. Pro tier users running production agent pipelines have 30-day observability logs but no formal audit API, creating a trust gap at exactly the tier most individual developers and small teams will be on." }, { "title": "No compounding value signals exposed via API", "detail": "\u2014 Semantic caching, cost optimization, and growing prompt libraries all represent compounding value, but none of this is surfaced programmatically. Agents can't read signals like \"cache hit rate trending up\" or \"your cost per query has dropped 30%\" which would justify continued subscription autonomously." }, { "title": "Enterprise pricing opacity", "detail": "\u2014 SCIM, SSO, VPC hosting, and advanced compliance features are all Enterprise-only with no threshold disclosed. Agents evaluating Portkey for higher-security deployments hit a \"contact sales\" wall with no programmatic path forward." } ], "priority_actions": [ { "action": "Add schema.org JSON-LD to homepage and pricing page", "points_gain": 4, "pillar": "P1", "effort": "Low" }, { "action": "Expose audit log API at Pro tier", "points_gain": 2, "pillar": "P3", "effort": "Medium" }, { "action": "Add a compounding value signal API", "points_gain": 2, "pillar": "P5", "effort": "Medium" }, { "action": "Publish agent-accessible pricing endpoint", "points_gain": 2, "pillar": "P1", "effort": "Low" }, { "action": "Add programmatic billing management API", "points_gain": 3, "pillar": "P5", "effort": "Medium" } ], "executive_summary": "Portkey scores in the Emerging tier (68/100) and is genuinely closer to Agent-Ready than almost any platform audited in this framework to date. Its strongest pillars are Clarity Stack and Velocity Triggers \u2014 the offer is well-defined, pricing is explicit, and activation requires only three lines of code. The MCP Gateway with OAuth 2.1 and RBAC is a meaningful differentiator, and the four-level permission model is architecturally sound for agent deployments. The critical gap holding Portkey back from Agent-Ready is the absence of schema.org markup (strong offer, invisible to structured data parsers) and the audit trail locked to Enterprise (the tier most agents won't be on). With schema markup, a Pro-tier audit log API, and a compounding value signal endpoint, Portkey could realistically reach 80+ and become the default agent-native AI gateway in the market.", "rubric_version": "v1-2026-04 (20 criteria, 100 raw points; P3-E Agent Registration added to rubric v2 in 2026-06, not scored in this audit)", "framework": "Agent Native Offers \u2014 The Agent Sale framework", "source_file": "2026-04-14 \u2014 Portkey \u2014 Agent Native Offer Audit.md", "rank": 4 }