Relevance Scanner

This scanner ensures that output remains relevant and aligned with the given input prompt.

By measuring the similarity between the input prompt and the output, the scanner provides a confidence score, indicating the contextual relevance of the response.

How it works

1. The scanner translates both the prompt and the output into vector embeddings.
2. It calculates the cosine similarity between these embeddings.
3. This similarity score is then compared against a predefined threshold to determine contextual relevance.

Example:

• Prompt: What is the primary function of the mitochondria in a cell?
• Output: The Eiffel Tower is a renowned landmark in Paris, France
• Valid: False

The scanner leverages the best available embedding model.

Usage

You can select an embedding model suited to your needs. By default, it uses BAAI/bge-base-en-v1.5.

from llm_guard.output_scanners import Relevance

scanner = Relevance(threshold=0.5)
sanitized_output, is_valid, risk_score = scanner.scan(prompt, model_output)

Optimization Strategies

Read more

Benchmarks

Test setup:

• Platform: Amazon Linux 2
• Python Version: 3.11.6
• Input length: 22
• Test times: 5

Run the following script:

python benchmarks/run.py output Relevance

Results: