Embedding & Rerank

Find by meaning.
Then put the best match first.

Embeddings shortlist the records closest in meaning to what you typed. An optional rerank model then reads your text together with each candidate and re-scores them, so the most relevant result rises to the top before anything reaches the AI step.

Find by meaning. Rank by relevance.
Trade Compliance & Sanctions · Search Similar Rules
Military-grade inertial navigation units for unmanned aerial vehicles
Step 1 · Embeddingcosine similarity
1SAN-2026-0002Russia — Defense Sector · 5A00271%
2SAN-2026-0005Belarus · 7A103 Inertial Navigation69%
3SAN-2026-0003Iran · 9A004 Space Launch Vehicles66%
4SAN-2026-0001North Korea (DPRK) · full embargo63%
Rerank
Step 2 · RerankReranked
1SAN-2026-0005Belarus · 7A103 Inertial Navigation94%
2SAN-2026-0003Iran · 9A004 Space Launch Vehicles58%
3SAN-2026-0002Russia — Defense Sector · 5A00231%
4SAN-2026-0001North Korea (DPRK) · full embargo—
Illustrative example — real scores depend on your model and your data.Rerank runs only when at least 2 matches clear the 60% threshold.
Embedding · Step 1

Search by meaning,
not by keywords

Every record and your query are turned into vectors by an embedding model. Records whose vectors point the same way are close in meaning — even when they share no words.

  • ✓
    Local Ollama on your own machine, or a hosted model from Modelion or OpenRouter
  • ✓
    A similarity threshold and Top-K keep only the matches worth reading
  • ✓
    Vectors are cached for the session, so repeat searches are instant
  • ✓
    No model, or the model is offline? Simple keyword matching still returns something useful
How Embedding Works
Embedding EngineSettings → Agentic
ProviderOllama (local) or Cloud LLM
Embedding modelnomic-embed-text · bge-m3 · voyage-4
Similarity thresholdMinimum 60%
Top-KBest 5 matches
If the model is unavailableKeyword matching
Rerank · Step 2 (optional)

A second look puts
the best match on top

Embeddings are fast but approximate. A rerank model is slower and sharper: it reads your text together with each shortlisted record and scores how well they truly fit, then reorders the list.

  • ✓
    Pick a model once in Settings → Agentic → Rerank — click it again to turn rerank off
  • ✓
    Free models available, such as NVIDIA Llama Nemotron Rerank VL 1B V2
  • ✓
    A green Reranked label tells you the second pass was applied
  • ✓
    Never blocks you: if the service is unavailable, you simply see the normal ranking
How Rerank Works
Rerank modelSettings → Agentic
Modelion (Gateway)
└─ modelion/qwen3-reranker-0.6b[Rerank]
OpenRouter
└─ NVIDIA: Llama Nemotron Rerank VL 1B V2 FREE[Rerank]
└─ Cohere: Rerank 4 Pro[Rerank]
└─ VoyageAI: rerank-2.5[Rerank]
└─ Qwen3 Reranker 8B[Rerank]
The Pipeline

Three steps from a question
to a grounded answer

Each step narrows the field. Every step also degrades gracefully, so a missing model never breaks the screen.

1

Embedding · Shortlist by meaning

Your text and every candidate record are embedded and compared. Records above the threshold, best first, make the shortlist.

Local or hosted
2

Rerank · Re-score the shortlist

An optional rerank model reads your text with each shortlisted record and reorders them. Only the strongest few move on.

Hosted · optional
3

AI synthesis · Reason over the best few

The AI step receives only the records you keep selected — a focused, relevant context instead of the whole ledger.

Your chosen AI engine
Always Works

Every step has a
safety net

Semantic features should never be the reason a screen stops working. Each layer falls back to the one below it.

  • ✓
    No rerank model selected, or the service is over its quota: the embedding order is kept, no error shown
  • ✓
    Embedding model unreachable: keyword matching still ranks your candidates
  • ✓
    Fewer than two matches above the threshold: rerank is skipped because there is nothing to re-order
  • ✓
    Nothing semantic is required to use a screen — these steps only make it smarter
Read the Settings Guide
Fallback chainAutomatic
if unavailable ↓
if unavailable ↓
Models

Pick the model that fits your needs

Catalogs are read live from your providers, so new models appear without an app update. The lists below show examples available today.

Embedding models

Where it runsExample modelsGood to know
Local (Ollama)nomic-embed-text, mxbai-embed-largeFree, private — the text never leaves your machine. Needs Ollama running.
Hosted (Modelion)bge-m3No local setup. Text goes through the TotalApp server to the provider.
Hosted (OpenRouter)voyage-4 and other embedding modelsLarge catalog, free models are marked.

Rerank models

ProviderExample modelsGood to know
OpenRouterNVIDIA Llama Nemotron Rerank VL 1B V2 (free)Free to try; 1B parameters, fast.
OpenRouterCohere Rerank 4 Pro / 4 Fast / v3.5, VoyageAI rerank-3 / rerank-2.5, Qwen3 Reranker 8BPaid options, higher capacity.
Modelionqwen3-reranker-0.6bGateway model, no separate key to manage.

Model names and availability change. Open Settings → Agentic to see the live list for your account.

Privacy

Know where your text goes

Local and hosted options trade convenience for control. You decide per feature.

Local embedding (Ollama)Hosted embedding & rerank
Where the text goesStays between your browser and your own machineSent through the TotalApp server to the model provider
SetupInstall Ollama and pull a modelPick a model from the list — nothing to install
CostFreeFree models available; paid models billed by the provider
Works offlineYesNo

Rerank is hosted-only. If your text must not leave your environment, use a local embedding model and leave Rerank unselected.

Where It’s Used

Already working across TotalApp

Embedding powers similar-record search in several places. Rerank is available today on one screen and will grow from there.

Attach KnowledgeWriter tools rank your own library as you type a topic.Embedding
Patent & R&D OperationsFinds the closest prior art, literature and licensing guidance.Embedding
Trade Compliance & SanctionsSearch Similar Rules shortlists the sanction rules that fit a shipment.Embedding + Rerank
Hospitality & EventsFinds similar contracts, safety notes and policies in your own records.Embedding
Why It Matters

Relevance you can trust

Better retrieval means a smaller, sharper context for the AI step — fewer wrong turns, lower cost.

More Accurate Matches

Rerank reads the question and each candidate together, so near-misses stop outranking the real answer.

Smaller, Cheaper Context

Send the AI step the few records that matter instead of the whole list.

Free to Try

Free embedding and rerank models are available, with a one-click filter in Settings.

Never a Dead End

Each layer falls back automatically, so a missing model never blocks your work.

You Stay in Control

Choose local or hosted, pick the model, and turn rerank off with a single click.

Complements the 2-Tier Architecture

Exact records come from deterministic queries; similarity search covers free-text discovery.

Learn More

Guides and related pages