Integrations
LiteLLM
You can use LiteLLM to interact with FriendliAI. This makes migration of existing applications already using LiteLLM particularly easy.
How to use
Before you start, ensure you’ve already obtained the FRIENDLI_TOKEN
from the Friendli Suite.
Add friendliai
prefix to your endpoint name for the model
parameter.
Chat completion
We provide usage examples for each type of endpoint. Choose the one that best suits your needs. You can specify one of the available models for the serverless endpoints.
Chat completion - Streaming
Was this page helpful?