Experience Overview

So far my biggest responsibilities have been the following:

1) Design and develop a new brand based rate limiting system that effectively handles the high throughput (10K+ calls per minute) that we are currently seeing and address the flaws of the current system

2) Improve metadata for every team that uses our service so that we have better governance over the flow of LLM calls into and our of our team's primary service

3) Continue to develop and improve our team's LangGraph service to enable teams creating scalable AI/agentic workflows