Skip to content

use multiple endpoints

Laurian Gridinoc requested to merge 15-multiple-ai-endpoints into main

Using env vars to customise model/temp/key/endpoint for each LLM call

Closes #15 (closed)

I tried first to use it via LiteLLMRouter, really nice choice but it does not work with tools/function-calling; and the only way to make it work would have been to be model specific (right now the tool to prompt template is managed by the endpoint depending on the model)

Merge request reports

Loading