100ms is looking for an AI Deployment Engineer to help build and improve our AI agents for U.S. healthcare. This role is central to our product delivery — you’ll work with Product, Operations, and Account Managers to make sure our agents are accurate, reliable, and always improving based on customer needs.
Deployment Engineers are hands-on builders. You won’t just design ideas; you’ll see them through from start to finish: testing, fixing, refining, and making sure our AI agents work smoothly in the real world. This role blends technical problem-solving, product sense, and customer focus to create AI that actually helps people.
Responsibilities
Understand Customer Needs
Work with Product and Account Managers to understand healthcare and insurance use cases.
Translate these needs into clear, working agent designs.
Build & Deploy Agents
Create and update prompts, conversation flows, and tool integrations.
Test agents thoroughly before they go live.
Make sure they’re reliable and ready for customer use.
Test & Improve Performance
Set up datasets and automated tests to measure quality.
Run real-world checks to catch and fix edge cases.
Continuously raise the bar for accuracy and consistency.
Support Customer Value
Ensure agent outputs (like benefit checks or call notes) show up correctly in dashboards.
Troubleshoot quickly and connect fixes to what customers see.
Partner with Operations to turn frontline issues into improvements.
Keep Workflows Running Smoothly
Maintain prompts, scripts, and rules so agents don’t break.
Ensure smooth hand-offs between AI and human support when needed.
Track long-term adoption and success metrics.
Success Looks Like
Fast and accurate updates to workflows.
Strong test coverage and reliable quality checks.
Quick turnaround from customer issues to product fixes.
Clean, accurate dashboards.
Tangible improvements in customer satisfaction.
What We’re Looking For
2–6 yrs Experience with prompt design and working with LLM-powered tools.
Comfort with APIs, dashboards, and light scripting (Python/JS).
Problem-solver who can debug as well as design.
Thinks about the whole system, from backend data to end-user experience.
Strong communicator who works well across Product, Ops, and Accounts.
Quick learner who’s motivated to turn new AI tech into dependable, customer-ready products.
Why This Role Matters
In healthcare, accuracy and trust are everything. Patients, providers, and payers rely on our AI agents to handle critical interactions. Deployment Engineers make this possible by turning AI from a raw model into something practical, reliable, and human-friendly.
Why 100ms
You'll be part of a small team at a fast-growing engineering-first startup.
You'll work with engineers across the globe with experience in video at places like Facebook and Hotstar.
You can grow as an individual contributor or as a team leader - freedom to set your own goals.
You'll work on problems at the cutting-edge of real-time video communication technology at a massive scale.
Additional Information
At 100ms, we place a strong emphasis on in-office presence to promote collaboration and strengthen company culture.
Under the current policy, employees are expected to work from the office at least three days a week—Tuesday, Wednesday, and Friday—as an essential part of their role.