A platform engineering team at Bloomberg has teamed up with Tetrate, a cloud-native application networking specialist, to start building a fully open-source “AI Gateway” that can sit in front of multiple LLMs and handle authentication, rate limiting and other features for enterprise teams – they are building this around the open source Envoy Gateway.
The two aim to open-source a minimum viable product (MVP) with three key functions ahead of the Kubecon conference in mid-November.