Product Engineer

The role

Orchestra turns production work and expert judgment into clearer evaluations, better model routes, and specialist models. The product should make that process understandable: what changed, whether it helped, and what to put into production next.

You’ll build the tools that let people move from a real task to a measured improvement. This role is for an engineer who cares about the experience as much as the implementation, and who can turn an ambiguous problem into something useful people can try.

What you’ll work on

• Build workflows for inspecting examples, reviewing model outputs, and capturing useful expert corrections.
• Make evaluation results easy to compare without losing the context behind quality, latency, and cost.
• Help teams manage prompts, routes, and model artifacts, with a clear record of what changed.
• Build the interfaces and supporting services for reviewing a candidate and putting it into production.
• Work from user feedback, prototypes, and real workloads to decide what to simplify or build next.
• Own the details that make a product dependable: accessibility, loading and failure states, performance, and understandable defaults.

What you’ll bring

• Experience shipping web products across the interface and the services behind it.
• Product judgment and an eye for clear interaction design, especially when the underlying system is complex.
• The ability to work through incomplete requirements by making a useful first version and learning from it.
• Care for data correctness and the difference between a convincing demo and a trustworthy workflow.
• Clear communication with both technical users and people who know their domain better than they know machine learning.

Experience with developer tools, data products, or AI applications would be useful. You don’t need to have worked on every part of the model lifecycle; you should be curious about how people evaluate and improve real work.

Tell us what you’ve built.

Show us a product or feature you built. Tell us who it was for, what you owned, and one change you made after seeing someone use it. Links to a live product, code, screenshots, or a short walkthrough are all welcome. Please omit confidential material.

Opens your email app. You can also write to founders@understudylabs.com.