Skip to main content

Introducing Friendli Serverless Endpoints

This tutorial will guide you through Friendli Serverless Endpoints, allowing you to seamlessly integrate state-of-the-art AI models into your workflows, regardless of your technical expertise. Whether you're a seasoned developer or a curious newcomer, get ready to unlock the limitless potential of generative AI!

What are Friendli Serverless Endpoints?​

Imagine there is a powerful racecar (a generative AI model) that needs much maintenance and tuning (infrastructure and technical know-how). Friendli Serverless Endpoints is like a rental service, taking care of the hassle so you can just drive! It provides a simple, serverless interface that connects you to Friendli Engine, a high-performance, cost-effective inference serving engine optimized for generative AI models. With Friendli Serverless Endpoints, you can:

  • Access popular open-source models: Get started with pre-loaded models like Mixtral, Llama-2, Gemma, Mistral, and Stable Diffusion. No need to worry about downloading or optimizing them.
  • Build your own workflows: Integrate these models into your applications with just a few lines of code. Generate creative text formats, code, musical pieces, email, letters, etc. and create stunning images with ease.
  • Pay per token, not per GPU: Unlike traditional solutions that require whole GPU instances, Friendli Serverless Endpoints bills you only for the resources your models actually use. This translates to significant cost savings and efficient resource utilization.
  • Focus on what matters: Forget about infrastructure setup and GPU optimization. Friendli Serverless Endpoints handles the heavy lifting, freeing you to focus on your creative vision and application development.

Getting Started with Friendli Serverless Endpoints:​

  1. Sign up for a free account: Visit Friendli Suite and create your FriendliAI account.
  2. Choose your model: Select the pre-loaded model you want to experiment with, such as Llama-2 for text generation or Stable Diffusion for image creation.
  3. Connect to the endpoint: Friendli Serverless Endpoints provides simple API documentation for a variety of programming languages. Follow the instructions to integrate the endpoint into your code.
  4. Send your input: Supply the model with your input text, code, or image prompt.
  5. Witness the magic: Friendli Serverless Endpoints will utilize Friendli Engine to process your input and generate the desired output, be it text, code, or an image. You can then integrate the generated results into your application or simply marvel at the AI's creativity!

Beyond the Basics:​

As you gain confidence, Friendli Serverless Endpoints offers even more:

  • Granular control: Optimize resource usage at the per-token or per-step level for each model, ensuring efficient resource allocation for your specific needs.
  • Scalability: As your needs grow, easily scale your resources without worrying about complex infrastructure management.

Friendli Serverless Endpoints is the perfect springboard for your generative AI journey. Whether you're a experienced developer seeking to integrate AI into your projects or a curious explorer yearning to unleash your creative potential, FriendliAI provides the tools and resources you need to succeed.

So, start your engines, take the wheel, and explore the vast possibilities of generative AI with Friendli Serverless Endpoints!

Additional Resources:​