Skip to content

About

Universal AI agent skill for ZeroEntropy - embeddings, reranking, and search

Resources

Contributing

Stars

1 star

Watchers

0 watching

Forks

Repository files navigation

ZeroEntropy logo

πŸŒ€ ZeroEntropy Agent Skill

Universal AI agent skill for ZeroEntropy β€” state-of-the-art embeddings, reranking, and end-to-end search.

GitHub release CI Status License: MIT Agents Supported Native Tools


ZeroEntropy provides blazing-fast, industry-leading search and retrieval tools. This repository houses the universal agent skill and the OpenCode plugin, empowering your favorite AI coding assistants (OpenCode, Claude Code, Cursor, GitHub Copilot, Goose, Codex) with 9 native high-performance tools.

🧠 Why ZeroEntropy?

Most RAG stacks bolt a generalist embedding API onto a generalist LLM and hope for the best. ZeroEntropy (YC W25, $4.2M seed led by Initialized Capital1) makes the opposite bet: small, retrieval-specialized models beat giant generalist ones at search β€” and the receipts back it up:

  • πŸ† Top-ranked reranking β€” zerank-2 scores NDCG@10 of 0.78 across 29 datasets2, and in Agentset's independent head-to-head it posts ELO 1638 vs Cohere Rerank 3.5's 1451, winning 57.2% of matchups3
  • ⚑ Built for production latency β€” mean rerank latency 265ms vs Cohere's 392ms, with only 2.7% of requests over 500ms (vs 14.3% for Cohere, 70.8% for Jina)23
  • 🌍 Best-in-class embeddings β€” zembed-1 beats OpenAI Large, Cohere v4, Voyage, BGE-M3, and Gemini Embeddings by up to +7% Recall@100, with majority-non-English training data for true multilingual RAG4
  • πŸ”“ Open weights, no lock-in β€” both models are released on Hugging Face and AWS Marketplace; zembed-1 scales from 2560 down to 40 dimensions with int8/binary quantization4
  • πŸ’° Half the price β€” $0.025/1M tokens vs $0.050 for Cohere reranking5, and Assembled measured a 2.8x cost reduction after moving 100% of reranking traffic over6
  • 🩺 Proven in high-stakes domains β€” Vera Health retrieves across 60M+ medical papers with ZeroEntropy and hit 97.5% on USMLE Steps 1–3 while cutting irrelevant citations by >90%7; Mem0, Sendbird, and Profound run it in production8
Metric zerank-2 Cohere Rerank 3.5
Head-to-head ELO3 1638 1451
Win rate3 57.2% 40.9%
Mean latency3 265ms 392ms
Requests >500ms2 2.7% 14.3%
Price / 1M tokens5 $0.025 $0.050

✨ What You Get

ZeroEntropy's powerful engine is built for deep developer integrations, providing:

  • zembed-1 β€” Multilingual embedding model (2560-dim default, configurable down to 40)
  • zerank-2 β€” Cross-encoder reranker for boosting search precision
  • zsearch β€” End-to-end search engine with OCR, chunking, embedding, and querying
  • Metadata filtering β€” MongoDB-style filters with array prefix rules
  • RAG pipelines β€” Complete index β†’ search β†’ rerank β†’ synthesize workflows
  • Collection management β€” Create, delete, and list collections
  • Batch operations β€” Index multiple documents in one call
  • Status polling β€” Check document indexing status

πŸš€ Quick Start

Get up and running with ZeroEntropy in under 60 seconds:

1. Install the Skill

Install the skill into your preferred AI agent:

npx skills add github:ShreeMulay/zeroentropy-skill

2. Configure Your API Key

Get your API key at dashboard.zeroentropy.dev and set it in your environment:

export ZEROENTROPY_API_KEY="your_api_key"

3. Ask Your Agent

Ask your agent to perform search, embedding, or RAG tasks:

"Search my knowledge base for RAG best practices"


πŸ”Œ OpenCode Plugin

If you are using OpenCode, you can activate the native plugin to unlock direct tool execution for maximum performance.

Configuration

Edit your ~/.opencode/config.json to include the plugin:

{
  "plugin": [
    "zeroentropy-opencode-plugin"
  ]
}

Installation Options

The plugin will be built locally from source after your skill is installed, or loaded from our packaged release tarball.


πŸ€– Supported Agents

This universal skill is fully compatible with any agent that supports the Vercel Agent Skills specification.

OpenCode (Recommended)

Full native plugin support with 9 built-in tools.

# 1. Install the skill
npx skills add github:ShreeMulay/zeroentropy-skill

# 2. Activate the native plugin in ~/.opencode/config.json
# (See the config snippet in the OpenCode Plugin section above)

# 3. Set your API key
export ZEROENTROPY_API_KEY="your_api_key"

Benefits: Direct execution of the 9 native tools with automatic retry, error handling, and type-safe parameters.

Claude Code

# Copy to the skills directory:
git clone https://github.com/ShreeMulay/zeroentropy-skill.git ~/.claude/skills/zeroentropy

Claude Code will read SKILL.md and learn how to use ZeroEntropy's Python/TypeScript SDKs.

Cursor

# Copy the skill to Cursor's skills directory
git clone https://github.com/ShreeMulay/zeroentropy-skill.git ~/.cursor/skills/zeroentropy

Cursor will discover SKILL.md automatically. The agent will use the SDK examples in examples/ and recipes/.

GitHub Copilot (Chat / VS Code)

# Copy to the GitHub Copilot skills directory
git clone https://github.com/ShreeMulay/zeroentropy-skill.git ~/.github/skills/zeroentropy

Copilot Chat will reference SKILL.md when you ask about ZeroEntropy, embeddings, or RAG pipelines.

Goose

# Copy to Goose's skills directory
git clone https://github.com/ShreeMulay/zeroentropy-skill.git ~/.goose/skills/zeroentropy

Goose will load SKILL.md and use the recipes for indexing, searching, and reranking.

Codex CLI

# Copy to Codex's skills directory
git clone https://github.com/ShreeMulay/zeroentropy-skill.git ~/.codex/skills/zeroentropy

Codex will read SKILL.md and follow the decision trees for when to use embed vs search vs rerank.

Other Agents

Any agent that reads Markdown files from a skills directory:

# Generic installation β€” just clone to the agent's skills folder
git clone https://github.com/ShreeMulay/zeroentropy-skill.git <AGENT_SKILLS_DIR>/zeroentropy

The agent will automatically discover SKILL.md and learn ZeroEntropy patterns.


🧰 Tools

When using the OpenCode plugin, the agent has direct access to these 9 native, type-safe tools:

Tool Icon Description
zeroentropy_search πŸ” Search with filters, reranking, snippets/pages/documents
zeroentropy_embed 🧬 Generate embeddings (2560β†’40 dimensions)
zeroentropy_rerank πŸ“Š Reorder results by relevance
zeroentropy_index πŸ“„ Index single document
zeroentropy_create_collection πŸ“ Create collection
zeroentropy_delete_collection πŸ—‘οΈ Delete collection
zeroentropy_list_collections πŸ“‹ List all collections
zeroentropy_status ⏳ Check if document is indexed
zeroentropy_batch πŸ“¦ Index up to 100 documents at once

🍳 Workflows

The skill guides agents through optimized, multi-step orchestration workflows depending on your request:

1. Full RAG Pipeline

Create collection ──> Batch index documents ──> Check status ──> Search ──> Rerank ──> Synthesize answer

Ask: "Search my knowledge base for RAG best practices" Execution: The agent calls zeroentropy_search automatically, or writes custom retrieval-augmented code.

2. Embedding for Clustering

Generate embeddings (zembed-1) ──> Use in your own clustering algorithm

Ask: "Generate embeddings for these sentences and cluster them" Execution: The agent handles the high-dimensional vectors with zembed-1 automatically.

3. Two-Stage Retrieval

Fast search (zsearch) ──> Rerank top results (zerank-2) ──> Return best matches

Ask: "Perform a two-stage search across my documents" Execution: Combining initial keyword/vector search with precision cross-encoder reranking.


πŸ’‘ Example Interactions

With the OpenCode Plugin (Native Tools)

Once installed, just ask your agent naturally:

"Search my knowledge base for RAG best practices"

The agent calls zeroentropy_search automatically and returns:

{
  "results": [
    { "path": "docs/rag-guide.md", "score": 0.95, "snippet": "..." }
  ],
  "count": 5
}

"Index these 10 documents into my collection"

The agent calls zeroentropy_batch with all documents at once.

"Create a new collection called 'research-papers'"

The agent calls zeroentropy_create_collection.

Without the Plugin (SDK Mode)

The agent reads SKILL.md and writes code using the ZeroEntropy SDK:

from zeroentropy import ZeroEntropy
zclient = ZeroEntropy()

# The agent knows to use zembed-1 for embeddings
response = zclient.models.embed(
    model="zembed-1",
    input_type="query",
    input="What is RAG?",
    dimensions=2560
)

πŸ—οΈ Plugin Architecture

Why use the OpenCode plugin instead of raw SDK code-generation?

Feature SDK Mode (No Plugin) Plugin Mode
Setup Agent writes code Native tools, zero setup
Speed Slow (code generation) Instant (direct API calls)
Error Handling Manual Automatic retry + backoff
Context Window Uses tokens for code Zero impact
Type Safety Runtime Compile-time (Zod schemas)

For deeper technical implementation details, please see plugin/README.md.


πŸ“‚ Repository Structure

The project is structured logically for ease of use, extension, and testing:

zeroentropy-skill/
β”œβ”€β”€ SKILL.md                 # Agent contract β€” the core skill file
β”œβ”€β”€ README.md                # This file
β”œβ”€β”€ skill.json               # Skill metadata for discovery
β”œβ”€β”€ recipes/                 # Detailed recipe guides
β”‚   β”œβ”€β”€ 01-embedding.md
β”‚   β”œβ”€β”€ 02-indexing.md
β”‚   β”œβ”€β”€ 03-searching.md
β”‚   β”œβ”€β”€ 04-reranking.md
β”‚   └── 05-rag-pipeline.md
β”œβ”€β”€ examples/                # Runnable code examples
β”‚   β”œβ”€β”€ python/
β”‚   β”œβ”€β”€ typescript/
β”‚   └── utils/               # Copy-paste helpers (retry, chunking)
β”œβ”€β”€ schemas/                 # JSON schemas for validation
β”‚   β”œβ”€β”€ metadata-filter.json
β”‚   └── index-config.json
β”œβ”€β”€ tests/                   # Test suite
└── .github/workflows/       # CI/CD

Releases & Packages

This is a documentation-first skill that agents can discover directly from SKILL.md, with tagged release artifacts available for pinned installs and human review.

  • Skill distribution: Via git clone or npx skills add
  • Plugin distribution: Built locally from source after skill install, or from the packaged release tarball
  • Versioning: Semantic versioning in skill.json and CHANGELOG.md
  • Release assets: SKILL.md, skill.json, README.md, and zeroentropy-skill-v1.1.6.tar.gz

To create the next release:

# Tag the current version after quality gates pass
git tag v1.1.6

# Push Forgejo first, then the GitHub mirror
git push forgejo v1.1.6
git push origin v1.1.6

# GitHub release artifacts are created by .github/workflows/release.yml

🀝 Contributing

We welcome contributions! Please see CONTRIBUTING.md for guidelines on adding new recipes, updating API coverage, and submitting pull requests.


πŸ“„ License

MIT Β© 2025 Shree Mulay

Footnotes

  1. ZeroEntropy Raises $4.2M Seed Round to Make AI Retrieval Truly Intelligent ↩

  2. ZeroEntropy Rerankers β€” benchmarks and tail-latency data ↩ ↩2 ↩3

  3. Agentset (independent): zerank-2 vs Cohere Rerank 3.5 ↩ ↩2 ↩3 ↩4 ↩5

  4. Introducing zembed-1 β€” multilingual embedding benchmarks and open weights ↩ ↩2

  5. ZeroEntropy Pricing ↩ ↩2

  6. How Assembled Powers High-Quality AI Customer Support with ZeroEntropy ↩

  7. How Vera Health Achieved State-of-the-Art Clinical Accuracy ↩

  8. zeroentropy.dev β€” trusted in production by Assembled, Profound, Sendbird, Mem0 ↩

About

Universal AI agent skill for ZeroEntropy - embeddings, reranking, and search

Resources

Contributing

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages