ComponentsBundles
LiteLLM
LiteLLM components available in ottom8: LiteLLM Proxy.
LiteLLM Proxy
Generate text using any LLM provider via a LiteLLM proxy with virtual key authentication.
| Input | Type | Required |
|---|---|---|
| LiteLLM Proxy URL | str | Yes |
| Virtual Key | str | Yes |
| Input | str | No |
| Model Name | str | Yes |
| System Message | str | No |
Advanced options: Max Retries, Max Tokens, Stream, Temperature, Timeout (seconds)
| Output | Type |
|---|---|
| Model Response | Message |
| Language Model | LanguageModel |