ComponentsBundles
Hugging Face
Hugging Face components available in ottom8: Hugging Face, Hugging Face Embeddings Inference.
Hugging Face
Generate text using Hugging Face Inference APIs.
| Input | Type | Required |
|---|---|---|
| Custom Model ID | str | Yes |
| HuggingFace HubAPI Token | str | Yes |
| Inference Endpoint | str | Yes |
| Input | str | No |
| Max New Tokens | int | No |
| Model ID | str | Yes |
| System Message | str | No |
Advanced options: Model Keyword Arguments, Repetition Penalty, Retry Attempts, Stream, Task, Temperature, Top K, Top P, Typical P
| Output | Type |
|---|---|
| Model Response | Message |
| Language Model | LanguageModel |
Hugging Face Embeddings Inference
Generate embeddings using Hugging Face Text Embeddings Inference (TEI)
| Input | Type | Required |
|---|---|---|
| HuggingFace API Key | str | No |
| Inference Endpoint | str | Yes |
| Model Name | str | Yes |
| Output | Type |
|---|---|
| Embeddings | Embeddings |