This is an OpenAPI reference of Friendli Endpoints API. You can interact with the API through HTTP requests from any language or via our Python SDK. To install the Python SDK, run the following command:

pip install friendli-client
  • To send inference requests to the Friendli Serverless Endpoints, send requests to the URI with the prefix: https://inference.friendli.ai.
  • To send inference requests to the Friendli Dedicated Endpoints, send requests to the URI with the prefix: https://inference.friendli.ai/dedicated.

For more information, visit FriendliAI.

Authentication

When using Friendli Endpoints API for inference requests, you need to provide a Friendli Token for authentication and authorization purposes. A Friendli Token serves as an alternative method of authorization to signing in with an email and a password. You can generate a new Friendli Token through the Friendli Suite, at your “User settings” page by following the steps below.

  1. Go to the Friendli Suite and sign in with your account.
  2. Click the profile icon at the top-right corner of the page.
  3. Click “User settings” menu.
  4. Go to the “Tokens” tab on the navigation bar.
  5. Create a new Friendli Token by clicking the “Create token” button.
  6. Copy the token and save it in a safe place. You will not be able to see this token again once the page is refreshed.