Tech notes & insights · AI × Full-stack × DevOps · 269+ hands-on writeups
Explore the latest tech trends

Self-Host a Local AI API Gateway with LiteLLM: One Entrance to Manage All Models, Handling Usage, Costs, Failover, and API Keys in One Go
Self-host an on-prem AI API Gateway with LiteLLM Proxy: a single OpenAI-compatible endpoint integrating 29 cloud and local models, with use-case aliases, usage and cost dashboards, multi-tier Fallback chains, and virtual key management, plus a complete config.yaml example.
Popular Posts
Most read articles

Podcast
Mark's Tech Insights — Daily AI News
Daily curated AI and tech trends. Catch the latest developments via audio summaries — covering AI applications, software architecture, DevOps, and engineering practice.
Subscribe to Newsletter
Subscribe to get new posts delivered instantly — never miss a tech share.
By submitting, you agree to receive emails. You can anytime.















































