Skip to main content

model

Model defines the AI Model used by the pipeline.

You can indicate multiple AI Models in the same pipeline and configure their execution using different Plugins such as routing, caching, cost management etc.

For example, in case your main AI Model doesn't respond or its too slow, you can define to fall-back to another AI Model.

 # Use 🧠 OpenAI-GPT 3.5
model:
- package: floom/model/connectors/openai
model: gpt-3.5
api-key: sk-1234567890abcdefg=

Each model uses a Model Connector package located at floom/model/connectors/openai. A model connector is the communication protocol implementation of a specific model.