Soham Ray

Soham Ray is a Research Engineer at Sierra, focused on building conversational AI agents. He has over four years of experience in the customer service AI space, conducting applied research on augmenting and automating task-oriented dialogue systems. He holds a Master’s degree in Computer Science from Cornell University, where he specialized in AI and NLP.

Posts by Soham Ray

𝜏²-bench: benchmarking agents in collaborative real-world scenarios

𝜏²-bench challenges AI agents not just to reason and act, but to coordinate, guide, and assist a user in achieving a shared objective. This leap from solo operation to co-ownership of a task pushes agents into a much more demanding space. And, critically, it reflects the kinds of tasks AI agents are increasingly being asked to perform in the real world.

June 10, 2025

Soham Ray

Posts by Soham Ray

𝜏²-bench: benchmarking agents in collaborative real-world scenarios

See what Sierra can do for you.

Posts by Soham Ray

𝜏²-bench: benchmarking agents in collaborative real-world scenarios