Feature × Audience

How do SaaS teams build RAG with Plugsky's architecture?

RAG for SaaS teams turns product docs and customer content into in-app answers without building a retrieval stack from scratch. Plugsky offers embeddings, collections and queries on an OpenAI-compatible API with citations, per-tenant collections, hybrid retrieval and reranking, plus flat monthly self-serve plans so unit economics stay predictable as usage grows.

Key facts

RAG endpointsPOST /v1/embeddings, POST /v1/rag/collections and POST /v1/rag/query
Embedding modelsplugsky-embed-v1 (1536 dimensions, OpenAI-ada compatible) and plugsky-embed-large (3072 dimensions)
Retrieval modesKeyword, vector and hybrid search with optional cross-encoder reranking
CitationsEvery query returns ranked chunks with source attribution
IngestionDocuments are chunked, embedded and indexed automatically per collection
Batch limitsUp to 2,048 inputs per embeddings request, max 8,191 tokens each
Data handlingPer-collection encryption at rest; API data is not used to train models
DeploymentHosted, VPC, on-prem and air-gapped options; 30+ models behind one API

TL;DR

  • Start with your own docs, then add per-tenant customer content.
  • A collection per tenant prevents cross-customer retrieval leaks.
  • Separate retrieval from generation to control latency and cost.
  • Stream responses and route simple questions to efficient models.
  • Flat monthly pricing keeps unit economics predictable as usage grows.

How it works, step by step

  1. Pick the first corpus: product documentation, help centre or release notes.
  2. Create collections per tenant or corpus class and keep keys server-side.
  3. Set a latency budget and choose retrieval mode and model tier to meet it.
  4. Stream answers and show citations so users can verify and give feedback.
  5. Add per-tenant rate limits and quotas to prevent noisy-neighbour effects.
  6. Build an evaluation set from real support questions and track recall.
  7. Open customer-content corpora tenant by tenant after the first corpus works.
1Pick the firstcorpus: productdocumentation, help2Create collectionsper tenant orcorpus class and3Set a latencybudget and chooseretrieval mode and4Stream answers andshow citations sousers can verify5Add per-tenant ratelimits and quotasto prevent6Build an evaluationset from realsupport questions

Original data

POST /v1/embedRAG endpointsplugsky-embed-Embedding modelsUp to 2,048 inBatch limitsHosted, VPC, oDeploymentSource: Plugsky facts table · updated 2026-09-26

Try it yourself

Open the embedding model comparison →

Why SaaS teams need RAG grounded in their own content

SaaS teams reach for RAG for two reasons: support deflection and product experience. Answers grounded in your documentation reduce ticket volume, and answers grounded in the customer's own workspace — tickets, notes, uploaded files — make the product feel like it understands the account. Both need the same retrieval core.

The hard parts are multi-tenancy and latency. A shared index across tenants is a data leak waiting to happen, and an answer that takes eight seconds is worse than a search box. Design collections per tenant or per corpus class, and set an explicit latency budget before choosing models.

The Plugsky RAG stack: embeddings, collections, queries

Plugsky collapses the usual multi-vendor RAG stack into three OpenAI-compatible endpoints: POST /v1/embeddings turns text into vectors, POST /v1/rag/collections creates and manages collections, and POST /v1/rag/query returns ranked chunks with citations. Ingestion is automatic — documents are chunked, embedded and indexed per collection — and retrieval supports keyword, vector and hybrid modes with optional cross-encoder reranking. The embedding models are plugsky-embed-v1 (1536 dimensions, OpenAI-ada compatible) and plugsky-embed-large (3072 dimensions). For SaaS teams the same endpoints run internal documentation search and customer-facing answers, with collection boundaries keeping tenants apart.

The controls SaaS teams should configure first

Run retrieval with managed collections and keep tenant keys server-side. Each tenant gets a collection boundary, per-key rate limits and quotas, and usage attribution through audit logs that record user, model and region. Because the embeddings endpoint is OpenAI-compatible, you can also keep vectors in your own store if your architecture already has one.

For latency, separate the paths: retrieval is fast and cacheable, generation is the slower leg. Use efficient models for classification and short answers, reserve stronger models for complex questions, and stream responses so perceived latency drops. Publish a status page and use the same region pinning story in your own security docs.

A practical pilot path

Ship your own documentation first, measure deflection and answer quality, then open customer-content corpora tenant by tenant. Build an evaluation set from real support questions and track retrieval recall as the corpus grows. Prototype on the free plan, then scale on a flat monthly plan. See the live pricing page for current plans.

Honest comparison

CapabilityPlugskyAssembling your own stackKeyword search only
RetrievalKeyword, vector and hybrid with optional rerankingYou integrate and tune each componentKeyword matching, no semantics
CitationsRanked chunks with source attributionYou build attribution yourselfDocument links, not passages
Embeddingsplugsky-embed-v1 (1536d) and plugsky-embed-large (3072d)Model choice spread across vendorsNot applicable
DeploymentHosted, VPC, on-prem and air-gappedDepends on every componentUsually on-prem already
Data handlingPer-collection encryption; API data not used to train modelsYou audit every vendorExisting controls apply
Time to first answerOne collection and a query callWeeks of integration workDays, with lower answer quality

Frequently asked questions

How do we keep tenant data separate?

Use a collection per tenant and a scoped key held server-side by your gateway, with per-key quotas and audit logs. The retrieval boundary is explicit rather than implied by metadata filters.

Will this stay affordable as usage grows?

Self-serve plans are flat monthly with unlimited fair-use usage and no per-token billing, so cost does not scale linearly with every query; see the live pricing page for current plans.

Do we have to change our application code?

No. The RAG endpoints are OpenAI-compatible, so existing SDKs, prompts and evaluation harnesses keep working when you point the base URL at Plugsky.

Is there a free plan?

Yes — plugsky-micro and plugsky-lite with 2 API keys and no credit card. A 14-day full-access trial is also available.

How is pricing structured?

Self-serve plans are flat monthly with unlimited fair-use usage and no per-token charges or overage fees. See the live pricing page for current plans.

Does Plugsky train on our data?

Plugsky states that API data is not used to train models, and collections are encrypted at rest; on Enterprise you can keep everything inside your own VPC.