Swap Your Embedding Model Without Wrecking RAG: The SOP
An embedding model upgrade SOP (basis October 9, 2026; pairs with the site's open-source and comparison pieces): switching embedding models means a full re-embed, and this SOP covers the decision and the drill in one pass. Step 0 audits your current setup: model and dims, context window, MRL usage, deployment form, prompt-prefix conventions - plus the production reminder (relayed) that a reranker often fixes retrieval misses in minutes before you re-embed anything. Five selection criteria: parameters/context/dimensions with MRL/license (HF API verified: EG2 apache-2.0 ungated but no LICENSE file, Qwen3 apache-2.0, BGE-M3 mit)/deployment form. EmbeddingGemma 2's task prompt prefixes are mandatory - queries as task: {...} | query: {...}, documents as title: {...} | text: {...}, seven task types each with a prefix; skip them and accuracy silently drops; encode(truncate_dim=512/256/128) trims vectors for up to 6x storage savings. Five execution steps: dual-run old vs new on sentence-transformers>=6.1.0 (same-prompt spot checks), canary cutover (framework only, no invented percentages), full re-embed with reconciliation and retirement, then an evaluation loop with Ragas/DeepEval linking to the site's RAG evaluation piece. Plain-text repos: github.com/UKPLab/sentence-transformers, huggingface.co/google/embeddinggemma-2.