Feature × Audience

How do startups build RAG with Plugsky's architecture?

RAG for startups is the fastest way to make a thin product feel smart: ingest your docs, retrieve the right passages and answer with citations. Plugsky provides managed embeddings, collections and queries on an OpenAI-compatible API, a free plan with plugsky-micro and plugsky-lite, and a path to VPC or on-prem deployment when a customer asks for it.

Key facts

RAG endpointsPOST /v1/embeddings, POST /v1/rag/collections and POST /v1/rag/query
Embedding modelsplugsky-embed-v1 (1536 dimensions, OpenAI-ada compatible) and plugsky-embed-large (3072 dimensions)
Retrieval modesKeyword, vector and hybrid search with optional cross-encoder reranking
CitationsEvery query returns ranked chunks with source attribution
IngestionDocuments are chunked, embedded and indexed automatically per collection
Batch limitsUp to 2,048 inputs per embeddings request, max 8,191 tokens each
Data handlingPer-collection encryption at rest; API data is not used to train models
DeploymentHosted, VPC, on-prem and air-gapped options; 30+ models behind one API

TL;DR

  • Use managed collections to ship, not to build retrieval infrastructure.
  • Keep the pgvector path open — the embeddings endpoint is standalone too.
  • Route easy questions to small models and protect your burn rate.
  • Start free; move to private deployment when a customer asks.
  • Exercise the pattern on your own docs before customer data.

How it works, step by step

  1. Ingest your own documentation and changelog as the first corpus.
  2. Create a collection and query it with real questions from support or sales.
  3. Show citations in the UI so users can verify answers and give feedback.
  4. Route simple questions to plugsky-micro or plugsky-lite and escalate only when needed.
  5. Track retrieval quality with a small evaluation set as the corpus grows.
  6. Add scoped keys per environment and audit logging before enterprise conversations.
  7. Move to region pinning or private deployment when a deal requires it.
1Ingest your owndocumentation andchangelog as the2Create a collectionand query it withreal questions from3Show citations inthe UI so users canverify answers and4Route simplequestions toplugsky-micro or5Track retrievalquality with asmall evaluation6Add scoped keys perenvironment andaudit logging

Original data

POST /v1/embedRAG endpointsplugsky-embed-Embedding modelsUp to 2,048 inBatch limitsHosted, VPC, oDeploymentSource: Plugsky facts table · updated 2026-09-26

Try it yourself

Open the best model for RAG selector →

Why startups need RAG grounded in their own content

Early-stage teams should not be building retrieval infrastructure. The first version of a RAG feature needs three things: your documents ingested, decent retrieval and answers with sources. Everything else — custom indexes, sharding, model fine-tuning — is a distraction until customers prove they want the feature.

Managed collections get you from documents to a working query endpoint quickly. If your architecture already uses pgvector, you can keep it: call the embeddings endpoint standalone and leave retrieval in your own code. Both paths use the same OpenAI-compatible format, so the decision is reversible.

The Plugsky RAG stack: embeddings, collections, queries

The retrieval pipeline is three calls: embed, collect, query. POST /v1/embeddings converts text to vectors using plugsky-embed-v1 (1536 dimensions, OpenAI-ada compatible) or plugsky-embed-large (3072 dimensions); POST /v1/rag/collections stores and indexes documents with per-collection encryption at rest; POST /v1/rag/query returns ranked chunks with source attribution. Keyword, vector and hybrid retrieval are all available, with optional cross-encoder reranking when precision matters more than raw recall. For startups, managed collections remove a build project: the first version is ingest, query and ship, and the standalone embeddings path stays open if you outgrow it.

The controls startups should configure first

Keep the cost curve flat while you find product-market fit. Start on the free plan and route simple questions to plugsky-micro or plugsky-lite; escalate to larger models only when the answer needs it. Because 30+ models sit behind one key, you can test quality tiers without changing providers, and self-serve plans are flat monthly with unlimited fair-use usage rather than per-token billing.

When the first enterprise buyer asks where data is processed, pin a region or move the workload to a VPC deployment; the application code does not change. Add scoped keys per environment and audit logging before that conversation, not during it.

A practical pilot path

A good first project is documentation Q&A: ingest your docs and changelog, answer questions about your own product, and put the widget on the marketing site. It exercises chunking, retrieval and citations on content you already own, with no customer data risk. Once retrieval quality holds, extend to customer content. See the live pricing page for current plans.

Honest comparison

CapabilityPlugskyAssembling your own stackKeyword search only
RetrievalKeyword, vector and hybrid with optional rerankingYou integrate and tune each componentKeyword matching, no semantics
CitationsRanked chunks with source attributionYou build attribution yourselfDocument links, not passages
Embeddingsplugsky-embed-v1 (1536d) and plugsky-embed-large (3072d)Model choice spread across vendorsNot applicable
DeploymentHosted, VPC, on-prem and air-gappedDepends on every componentUsually on-prem already
Data handlingPer-collection encryption; API data not used to train modelsYou audit every vendorExisting controls apply
Time to first answerOne collection and a query callWeeks of integration workDays, with lower answer quality

Frequently asked questions

Is the free plan enough to build a RAG prototype?

Yes. The free plan includes plugsky-micro and plugsky-lite with 2 API keys and no credit card, which covers a documentation Q&A prototype end to end. A 14-day full-access trial supports wider testing.

Should we use managed collections or our own vector store?

Use managed collections unless you already operate a vector database. Keep the embeddings call OpenAI-compatible so you can swap to pgvector or another store later without changing the model interface.

Do we have to change our application code?

No. The RAG endpoints are OpenAI-compatible, so existing SDKs, prompts and evaluation harnesses keep working when you point the base URL at Plugsky.

Is there a free plan?

Yes — plugsky-micro and plugsky-lite with 2 API keys and no credit card. A 14-day full-access trial is also available.

How is pricing structured?

Self-serve plans are flat monthly with unlimited fair-use usage and no per-token charges or overage fees. See the live pricing page for current plans.

Does Plugsky train on our data?

Plugsky states that API data is not used to train models, and collections are encrypted at rest; on Enterprise you can keep everything inside your own VPC.