feat(benchmark): add MiniMax as LLM provider for HomeSec-Bench#176
feat(benchmark): add MiniMax as LLM provider for HomeSec-Bench#176octo-patch wants to merge 1 commit intoSharpAI:developfrom
Conversation
…Bench Add MiniMax Cloud API (M2.7, M2.7-highspeed, M2.5, M2.5-highspeed) as a built-in provider preset for the Home Security AI Benchmark, enabling users to benchmark MiniMax models against local and other cloud LLMs. Changes: - Provider presets system with auto-configured base URL for MiniMax (api.minimax.io) and OpenAI - MiniMax auto-detection via AEGIS_LLM_API_TYPE=minimax or base URL - Temperature clamping [0, 1.0] for MiniMax API compatibility - MINIMAX_API_KEY env var as fallback when AEGIS_LLM_API_KEY is not set - MiniMax recognized as cloud API for stream_options support - config.yaml: llmProvider selector (builtin/openai/minimax) and minimaxModel selector (M2.7, M2.7-highspeed, M2.5, M2.5-highspeed) - Updated SKILL.md with provider docs, supported providers table, standalone usage examples - README.md: mention MiniMax as benchmark provider option - 52 tests (49 unit + 3 integration) covering provider resolution, model defaults, detection, temperature clamping, config validation
|
@octo-patch , thanks for your PR, I understand the requirements is to enable MiniMax. |
|
Thank you @solderzzc! Sounds good — looking forward to hearing back once you've had a chance to review the full pipeline. Happy to adjust anything on this PR in the meantime. |
|
Thanks for the update @solderzzc! Great to see the progress on multi-provider API integration. Looking forward to the release — let me know if there's anything I should adjust on this PR to align with the new architecture. |
|
Hi, @octo-patch
|
|
@octo-patch , thanks for your patience, we've been working on Cloud API integration, MiniMax is top tier for now, the benchmark code doesn't need to be changed. Since we enabled many cloud APIs and 10k-20k code base change, so we are testing still. If you want, please check out the latest version ( not yet rolling out ) below. https://releases.sharpai.org/releases/SharpAI-Aegis-Setup-0.2.9-win-x64.exe https://releases.sharpai.org/releases/SharpAI-Aegis-0.2.9-arm64.dmg |

Summary
Add MiniMax Cloud API as a first-class LLM provider for the Home Security AI Benchmark (HomeSec-Bench), enabling users to benchmark MiniMax models (M2.7, M2.7-highspeed, M2.5, M2.5-highspeed) against local Qwen/DeepSeek and other cloud providers like OpenAI.
Changes
Files Changed (5 files, 538 additions)
scripts/run-benchmark.cjsconfig.yamlSKILL.mdREADME.mdtests/minimax-provider.test.cjsUsage
MiniMax Models
Test Plan