Perplexity Research and turbopuffer have released pplx-embed-v2-context-9b-preview, an open-weight embedding model for retrieval-augmented generation. Perplexity announced it on 1 October, though some coverage dates it 30 September.
Most systems embed each chunk of a document on its own. This model encodes every chunk with the whole document in view, then returns a separate vector for each chunk.
What's different
The training signal. Instead of a single "gold passage" label, a context-compression model scores each word in a document for relevance to the query, and those scores become chunk-level targets. So the model learns to surface the chunks that disambiguate and support an answer, not only the answer sentence.
It was trained on about 430 datasets in more than 50 languages, and supports native int8 embeddings. The licence is reported as MIT.
The caveats
- it is a preview, so weights, APIs and embeddings may change and may not stay compatible
- the headline results are Perplexity's own, and one benchmark (turbopuffer's context-bench) is private
- it doesn't win every task
Why it matters
Retrieval decides what evidence an ai answer can draw on at all. Ranking the supporting context higher goes at one real cause of answers you can't check.
- RuntimeWire: Perplexity's contextual embeddings retrieve answers and evidenceruntimewire.com
- MarkTechPost: Perplexity releases pplx-embed-v2-context-9b-previewmarktechpost.com
- Complete AI Training: Perplexity releases contextual embedding modelcompleteaitraining.com
researched and written by aida