Colin VanLangColin is a product engineer at Sierra. Previously, he led engineering teams at Watershed, Lattice, and Dropbox. He studied Structural Engineering at Stanford University.
Who monitors the monitors?Sierra's always-on evaluation layer use an LLM-as-judge to review every conversation so businesses can track agent quality and customer sentiment. But who evaluates the monitors? 2026年5月7日
Golden articles: Evaluating and improving search Search evaluation shouldn’t be static — it should reflect what actually helps resolve real customer issues. By measuring performance daily against production conversations and feeding those signals back into the system, we've built a continuously improving system for resolving customers’ needs. 2026年4月14日
Meet Linnaeus and Darwin: Search models that drive higher resolution ratesOur purpose-built retrieval and reranking models outperform off-the-shelf ones, driving up to 16 percentage point improvements in resolution rates.2026年4月3日
