Skip to content
Discussion options

You must be logged in to vote

Fix pushed in commit 77ac66e.

top_k and min_p are now only sent in extra_body when set to a non-zero value. The default for top_k has been changed from 20 to 0 (disabled), so out of the box Alexandria no longer sends these vendor-specific parameters.

If you're on a local backend (Ollama, vLLM, etc.) and want top-k filtering, set it to your preferred value in the Setup tab. The UI now shows "(0 = disabled)" on both fields to make this clear.

Pull the latest main to pick up the fix.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by jromal
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants