Inference🔗
Replicate
Released Jun 1, 2022
API platform to run ML models without managing infrastructure.
APICloudMLServerless
Back to resources
RunPod Serverless
Released on Mar 1, 2023
Serverless platform for deploying and auto-scaling AI models with GPUs.
Features
- Auto-scaling
- Pay-per-use
- Multi-GPU
- Global CDN
Tags
Useful links
Discover RunPod Serverless
Visit the official site to download, learn more and start using RunPod Serverless.
Related resources — Inference
Inference🟠
Anthropic Claude
Released Mar 14, 2023
Inference API for Anthropic's Claude models (Claude 1 since 2023). Like OpenAI, you pay per token, input and output, with request limits per plan: the frontier path with no servers of your own.
APIFrontierPaga-al-tokenCloud
Inference⚡
faster-whisper
Released Feb 11, 2023v1.2.1
Reimplementation of Whisper based on CTranslate2: up to 4 times faster than openai/whisper with the same accuracy and less memory. Supports 8-bit quantization on both CPU and GPU.
AudioTrascrizioneOpen SourceLocale