Open Source Tools Tagged inference

Open-source container orchestrator designed for AI teams. Manage GPU workloads, dev environments, and model deployments across any cloud or on-prem cl

Open-source container orchestrator designed for AI teams. Manage GPU workloads, dev environments, and model deployments across any cloud or on-prem cluster. It is positioned as an open-source alternative to Docker Swarm, Kubernetes. Primary category: Container Orchestration. Detected stack: JavaScript, Github Actions, NodeJS, CSS, Bash, Typescript. Review the imported record before publishing or editing SEO copy.

Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedr

Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock. It is positioned as an open-source alternative to Eden AI, Vercel AI Gateway, Cloudflare AI Gateway, Kong AI Gateway. Primary category: AI Gateways. Detected stack: JavaScript, Github Actions, NodeJS, CSS, Bash, Typescript. Review the imported record before publishing or editing SEO copy.

Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performanc

Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring. It is positioned as an open-source alternative to Eden AI, Vercel AI Gateway, Cloudflare AI Gateway, Kong AI Gateway. Primary category: AI Gateways. Detected stack: JavaScript, Github Actions, NodeJS, CSS, Bash, Typescript. Review the imported record before publishing or editing SEO copy.