Kimberly Patron

Kimberly is an Infrastructure Engineer at Sierra. Prior to Sierra, she was a Staff Infrastructure Engineer at Slack, led core infrastructure at Quip, and worked on production systems at Meta and its planet scale data platform.

Articles de Kimberly Patron

A more reliable inference layer for foundation models

Foundation models are still less reliable than traditional web services, with more downtime and response times measured in seconds, not milliseconds. And as adoption grows, they’re accessed through a burgeoning ecosystem of providers and applications, which have similar functionality but different levels of reliability. Last year, we turned this bug into a feature—developing an adaptive routing client that dynamically selects providers to maximize uptime, minimize latency, and improve the overall experience.

26 juin 2025

Kimberly Patron

Articles de Kimberly Patron

A more reliable inference layer for foundation models

Découvrez comment Sierra peut vous aider.

Articles de Kimberly Patron

A more reliable inference layer for foundation models