Senior ML/Software Engineer Conversational AI - Remote
August 28, 2025
What you’ll do
- Optimize the conversational AI pipeline: design, modeling, evaluation, A/B testing, and production rollout.
- Design and build production systems at scale—microservices, data pipelines, and APIs—emphasizing performance, resilience, and observability.
- Build and optimize streaming inference services (low-latency, high-throughput) with robust monitoring and autoscaling.
- Drive quality with rigorous metrics (WER, latency, stability, task completion), error analysis, and continuous evaluation.
- Partner with product, infra, and research teams to translate requirements into shippable systems.
What you'll bring
Requirements
- 8+ years of experience building machine learning systems or large-scale software systems.
- Proven track record in designing, building, and operating large-scale distributed systems with strict latency/SLO targets and high reliability.
- Proficiency in asynchronous programming, multi-threaded architectures, and streaming optimization.
- Experience in ML, ASR, NLP, or adjacent sequence modeling, with a strong foundation in modern deep learning.
- Hands-on experience with data-driven experimentation, evaluation, and optimization.
- Expertise in Python is highly desirable.
- Excellent communication skills, with the ability to lead projects and mentor engineers.
Nice to have
- Basic knowledge of signal processing and telephony systems.
- Experience deploying models to production, including Kubernetes, observability, and CI/CD.
To apply, send your resume to hello@marrlabs.com and include the job title in the subject line 
