{ "company": "Smithery", "slug": "smithery", "website": "https://smithery.ai", "audit_date": "2026-04-07", "overall_score": 36, "tier": "Agent-Invisible", "tier_as_published": "A", "pillars": { "P1": { "name": "Signal Architecture", "score": 10, "max": 25 }, "P2": { "name": "Clarity Stack", "score": 6, "max": 25 }, "P3": { "name": "Trust Envelope", "score": 7, "max": 20 }, "P4": { "name": "Velocity Triggers", "score": 5, "max": 10 }, "P5": { "name": "Gravity Design", "score": 8, "max": 20 } }, "criteria": [ { "id": "P1-A", "pillar": "P1", "name": "Structured Data", "score": 0, "max": 5, "evidence": "Homepage and all primary pages return HTTP 403 to non-browser agents. No schema.org markup accessible or confirmed via search. Completely opaque to machine scrapers." }, { "id": "P1-B", "pillar": "P1", "name": "Machine-Readable Pricing", "score": 0, "max": 5, "evidence": "Pricing page (/pricing) returns 403. Pricing tiers (Hobby/Pro/Custom) are known to exist from search results but inaccessible to any agent attempting programmatic evaluation. No JSON, schema.org/Offer, or API endpoint for pricing found." }, { "id": "P1-C", "pillar": "P1", "name": "llms.txt / Agent Layer", "score": 3, "max": 5, "evidence": "Docs accessible in LLM-friendly format: any page can be fetched as markdown by appending .md to the URL, and documentation is accessible via MCP at https://smithery.ai/docs/mcp. No formal /llms.txt file confirmed (requests returned 429). Developer-facing but not formally agent-facing." }, { "id": "P1-D", "pillar": "P1", "name": "API / MCP Availability", "score": 4, "max": 5, "evidence": "TypeScript SDK, Smithery CLI, scoped service tokens for agent use, managed OAuth for 3rd-party integrations, connection management API. No published OpenAPI spec or agent card found. Strong developer tooling but not fully agent-publishable." }, { "id": "P1-E", "pillar": "P1", "name": "Discoverability (GEO)", "score": 3, "max": 5, "evidence": "Smithery is widely referenced across AI tooling literature and search results. 7,300+ MCP servers create substantial indexable content. No explicit AI retrieval optimization or robots.txt directives found (returned 429). Organic coverage rather than deliberate GEO strategy." }, { "id": "P2-A", "pillar": "P2", "name": "Offer Completeness", "score": 1, "max": 5, "evidence": "Pricing tiers are known to exist (Hobby/Pro/Custom) but the pricing page returns 403 to agents. What's included in each tier is not findable from any accessible source. An agent cannot determine what it would receive or pay without human intervention." }, { "id": "P2-B", "pillar": "P2", "name": "Scope & Limits", "score": 1, "max": 5, "evidence": "No rate limits, connection limits, or usage caps documented in any accessible page. Docs page references service tokens and connection counts but no numeric limits stated." }, { "id": "P2-C", "pillar": "P2", "name": "Substitution & Fallback Rules", "score": 0, "max": 5, "evidence": "No guidance found on what happens when a hosted MCP server is unavailable, a credential expires, or a connection drops. No documented fallback behavior for agents." }, { "id": "P2-D", "pillar": "P2", "name": "Conditional Logic Transparency", "score": 1, "max": 5, "evidence": "Service tokens have conditional scoping (namespace, operations, metadata, TTL) documented in Connect docs, but these are developer-facing implementation details rather than agent-readable offer conditions. No \"contact sales\" wall found, but conditions are embedded in SDK documentation rather than machine-parseable." }, { "id": "P2-E", "pillar": "P2", "name": "Semantic Precision", "score": 3, "max": 5, "evidence": "Core value proposition is clear: \"Largest open marketplace of MCP servers\" with specific server count (7,300+). Technical docs are reasonably precise. Marketing copy (\"Turn scattered context into skills for AI\") leans vague." }, { "id": "P3-A", "pillar": "P3", "name": "Verifiable Performance", "score": 1, "max": 5, "evidence": "No uptime data, SLA documentation, or status page found in any accessible source. Only finding: Smithery states configuration data is \"ephemeral\" and not retained long-term. No third-party verification present." }, { "id": "P3-B", "pillar": "P3", "name": "Scoped Permissions", "score": 4, "max": 5, "evidence": "Service tokens provide genuine agent-scoped permissions: restrictable by namespace, resources, operations, and user metadata with configurable TTLs. Backends mint short-lived tokens (e.g., 1-hour TTL) for specific agent use cases. Documented and implementable. Missing: dollar-bounded or action-count-bounded scoping would push to 5." }, { "id": "P3-C", "pillar": "P3", "name": "Audit Trail", "score": 1, "max": 5, "evidence": "Usage metrics are logged for hosted servers. No machine-accessible audit log API documented. No request history, no transaction endpoint, no agent-queryable record-keeping." }, { "id": "P3-D", "pillar": "P3", "name": "Behavioral Consistency", "score": 1, "max": 5, "evidence": "No version-controlled terms, no stated notice period for changes, no changelog or stability track record found in accessible sources." }, { "id": "P4-A", "pillar": "P4", "name": "Friction-Free Activation", "score": 3, "max": 5, "evidence": "Smithery CLI (`smithery install`) enables fast local MCP setup. Self-serve signup implied (Hobby tier exists). Cannot confirm instant API key issuance due to 403 blocks on pricing/signup pages. TypeScript SDK allows programmatic integration without human gate once credentials exist." }, { "id": "P4-B", "pillar": "P4", "name": "Agent Decision Signals", "score": 2, "max": 5, "evidence": "Server install counts visible on individual MCP server pages. Free browsing of the registry. No explicit agent-legible signals for when/why to activate a paid tier. No free trial with upgrade triggers documented." }, { "id": "P5-A", "pillar": "P5", "name": "Integration Depth / Switching Cost", "score": 3, "max": 5, "evidence": "Long-lived connections with stored OAuth credentials create real switching cost. Agent frameworks that route through Smithery's managed OAuth would require re-architecting to leave. Network effect nascent but growing." }, { "id": "P5-B", "pillar": "P5", "name": "Agent Memory / Personalization Layer", "score": 2, "max": 5, "evidence": "Connection metadata storage with filtering (e.g., by userId) allows some user-to-connection association. No agent preference profile, no session learning, no personalization beyond connection state." }, { "id": "P5-C", "pillar": "P5", "name": "Programmatic Renewal", "score": 1, "max": 5, "evidence": "No subscription renewal API or auto-renewal mechanism found. No evidence of agent-executable plan upgrades or renewals." }, { "id": "P5-D", "pillar": "P5", "name": "Compounding Value Signal", "score": 2, "max": 5, "evidence": "Registry grows over time (7,300+ servers as of audit). No agent-readable signal that Smithery's value to a specific agent compounds with usage. Static utility rather than compounding." } ], "strongest_signals": [ { "title": "Genuine agent-scoped permission model (P3-B: 4/5)", "detail": "Service tokens are a real, implementable feature \u2014 scoped by namespace, operations, metadata, and TTL. This is more than marketing. It's the kind of infrastructure that lets an agent operate with least-privilege access, which sophisticated agent builders need." }, { "title": "Docs accessible as LLM-friendly markdown", "detail": "Any Smithery doc page can be fetched as .md by appending .md to the URL. The docs MCP server at smithery.ai/docs/mcp means agents can query documentation programmatically. Most platforms don't have this." }, { "title": "Market position as the de-facto MCP registry", "detail": "With 7,300+ servers, Smithery has the broadest MCP server catalog available. An agent that needs any external tool capability will likely find it here. Network gravity from volume is real." } ], "critical_gaps": [ { "title": "Bot wall destroys agent evaluation (P1-A, P1-B: 0/5 each)", "detail": "Homepage and pricing return 403 to all non-browser clients. This is the single most damaging issue: an AI agent attempting to evaluate, compare, or select Smithery's services cannot access any pricing or offer information programmatically. The platform sells to AI agent developers but blocks AI agents from evaluating it." }, { "title": "Zero pricing transparency for machines (P2-A: 1/5)", "detail": "Hobby/Pro/Custom tiers exist but are completely inaccessible. No pricing API, no schema.org/Offer, no JSON feed. An agent cannot autonomously decide to upgrade, compare tiers, or budget." }, { "title": "No uptime or SLA documentation (P3-A: 1/5)", "detail": "For a platform that markets itself as infrastructure for AI agents, the absence of any SLA or status page is a significant trust gap. Agents and their builders need reliability guarantees before routing critical workflows through Smithery." }, { "title": "No audit trail API (P3-C: 1/5)", "detail": "Usage metrics are logged internally but not exposed. Agent systems building on Smithery have no way to query their own activity history, debug connection issues, or provide audit records to their own users." } ], "priority_actions": [ { "action": "Publish a /llms.txt with structured offer summary", "points_gain": 2, "pillar": "P1", "effort": "Low" }, { "action": "Publish a public status page with uptime data", "points_gain": 4, "pillar": "P3", "effort": "Low" }, { "action": "Document rate limits and connection caps per tier", "points_gain": 3, "pillar": "P2", "effort": "Low" }, { "action": "Create an agent activity log API endpoint", "points_gain": 3, "pillar": "P3", "effort": "Med" } ], "executive_summary": "Smithery sits in the paradoxical position of being the leading MCP server registry for AI agents while scoring Agent-Invisible (36/100) \u2014 primarily because the platform's own bot-blocking infrastructure prevents AI agents from evaluating its pricing and offer. The strongest pillar is the scoped service token permission model (P3-B: 4/5), which is genuinely useful for agent developers, and the growing 7,300-server registry creates real gravitational pull. The critical gaps are structural: agents cannot read pricing (403 blocks), there is no SLA or status page, and no audit trail API exists. The highest-ROI fix is removing the bot wall and publishing a /pricing.json endpoint \u2014 a single infrastructure change that would add 8 points and bring Smithery into the Emerging tier (44/100). For a platform that explicitly markets itself as \"infrastructure for AI agents,\" basic agent-readability of its own offer is the first gap to close.", "rubric_version": "v1-2026-04 (20 criteria, 100 raw points; P3-E Agent Registration added to rubric v2 in 2026-06, not scored in this audit)", "framework": "Agent Native Offers \u2014 The Agent Sale framework", "source_file": "2026-04-07 \u2014 Smithery \u2014 Agent Native Offer Audit.md", "rank": 29 }