Skip to content

Search the site

AIAPIsopen sourcebloombergTetrate

Bloomberg’s Platform Engineers team up with Tetrate to build and open source a new AI Gateway

Streamlined authentication, monitoring of LLM use across multiple models? Holy Terminal, Batman, why buy it when build it and open-source it never went out of fashion.

Deeply realistic artist's illustration of the project courtesy of ChatGPT.

A platform engineering team at Bloomberg has teamed up with Tetrate, a cloud-native application networking specialist, to start building a fully open-source “AI Gateway” that can sit in front of multiple LLMs and handle authentication, rate limiting and other features for enterprise teams – they are building this around the open source Envoy Gateway.

The two aim to open-source a minimum viable product (MVP) with three key functions ahead of the Kubecon conference in mid-November.

This post is for subscribers only

Subscribe

Already have an account? Sign In

Latest