Lab ยท LLM caching

Exact hash vs semantic similarity

Type a paraphrase of a stored prompt. Above the similarity threshold you would reuse a cached answer instead of calling the model.

0.82