AI Guides › Skills & Agents

What A Skill Marketplace Doesn't Tell You About Provenance

By Nigel Guy · 3 min read

A marketplace listing tells you what a skill claims to do, sometimes a star rating, sometimes an install count. It's easy to read that as a reasonable proxy for trustworthiness — popular, well-rated things are usually fine, most of the time, in most contexts. But none of that is the same thing as provenance: who actually wrote it, what it actually touches once installed, and whether either of those has changed since the listing earned its rating. A listing can be accurate, popular, and still tell you nothing about the one question that matters before you grant it access to anything real.

The mechanism

1. Check who published it. A named individual or organisation you can independently verify is a different risk profile from an anonymous or unverifiable publisher, regardless of how the listing itself is worded. Marketplaces vary a great deal in how much they verify this on a publisher's behalf, so don't assume the platform has already done this check for you.
2. Read the actual permission list it requests, not the marketing description of what it does. The description sells the feature; the permission list is the real scope of access, and the two aren't always as closely matched as the listing implies.
3. Check when it was last updated. A rating attached to a listing can be old, earned by an earlier version, while the current version behaves differently. A skill with a healthy rating and no recent update is worth a second look, not automatic trust.
4. Check whether it depends on a specific external service still active in the form the skill expects. A skill built against a tool's older API can still be listed and installable long after that dependency has moved on underneath it.
5. Treat reviews and ratings as unverified claims, not audited fact. Whether a given marketplace's review system is itself checkable — verified purchasers only, moderated for authenticity, or just an open count — varies by platform and is worth confirming rather than assuming, since this differs enough between marketplaces that no single description covers all of them.

What to skip

Skip trusting a star rating alone as a substitute for actually reading what a skill does and requests — a rating tells you how many people were satisfied, not what it was doing when they were. And skip assuming "popular" implies "audited"; popularity and independent verification are different things that happen to correlate sometimes, not the same guarantee.

Guardrails

• This checklist gives you a way to look harder, not a way to be certain — no amount of listing-reading substitutes for the same test-before-trust discipline you'd apply to any new skill, from any source, including your own.
• Marketplace verification practices, review systems, and publisher disclosure requirements vary by platform and change over time — check the current policy of whichever marketplace you're using rather than assuming it matches what's described here.
• Provenance matters most in proportion to what the skill can touch — a read-only, low-stakes skill from an unverified publisher is a different risk than one requesting write access to something real, and the scrutiny should scale accordingly.

All 751 AI guides · JulieMango plans from £17/mo