Senior ML Ops Engineer
Skills
- 5+ years owning production ML serving systems or related platform/infrastructure engineering experience.
- Hands-on experience deploying and maintaining LLMs and deep learning models in production.
- Strong Python and software engineering fundamentals with infrastructure familiarity.
- Experience with cloud platforms (AWS, GCP, or Azure) and ML lifecycle tooling (model registries, experiment tracking).
- Practical knowledge of inference optimization: batching, memory management, quantization, CPU/GPU interaction.
- Experience with CI/CD, testing, observability, and incident response for ML systems.
- Ability to reason about tradeoffs between latency, cost, throughput, and reliability.
Responsibilities
- Build, maintain, and optimize production-grade ML pipelines to move models from experimentation to production reliably.
- Define and implement model versioning, rollout, rollback, and lifecycle management practices.
- Set and enforce serving-layer SLAs (latency, availability, GPU utilization, TTFT, ITL) and build observability and alerting.
- Apply software engineering best practices (testing, CI/CD, reproducibility) to ML workflows.
- Ensure ML systems are secure, cost-efficient, and scalable in partnership with DevOps while owning ML-specific operational needs.
- Collaborate cross-functionally with ML, Data, Product, and DevOps teams to translate requirements into production-ready systems and influence roadmap.
Education
- Bachelor’s or Master’s degree in Computer Science, Data Science, or related field, or equivalent practical experience.
Benefits
- Competitive base salary ($200,000–$250,000) with equity (stock options).
- Medical, dental, and vision coverage.
- 401(k) plan.
- Flexible PTO and company holidays.
- Fully remote work within the United States with periodic company offsites and team gatherings.
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Help scale Chime's AI-powered Jade assistant by building platform tooling, backend services, and observability systems as a Senior Full-Stack Engineer.
Lead frontend architecture and platform engineering for ServiceNow's AI Agents product, shaping reusable UI systems and scalable backend services.
Senior Angular/Full-Stack Engineer to drive front-end architecture and build provider-facing treatment planning and eligibility UIs at Wellfit, working across Product, Design, and backend teams.
Senior Software Engineer (Mobile) to lead and deliver high-quality React Native mobile experiences while contributing across Rev’s full-stack platform to accelerate growth and engagement.
Lead the design and delivery of mission-critical, event-driven middleware for a private markets fintech platform while mentoring engineers and shaping backend engineering practices.
Lead the design and implementation of evaluation infrastructure and observability for enterprise-grade AI agents powering audit and assurance workflows at Fieldguide's San Francisco office.
Senior Director responsible for leading application engineering and productionization to deliver enterprise-grade AI/ML and digital applications at scale for Pfizer's AI Acceleration organization.
NBC News is hiring Academic Year interns in New York across product, design, data/graphics, mobile development, and software engineering to contribute to real projects while earning $30/hour.
Experienced Angular frontend developer needed to implement accessible, component-driven web interfaces for a federal modernization program and collaborate with UX, backend, and product teams.
Work on Patreon's Identity & Access team to design and implement authentication, verification, and anti-account-takeover systems that protect creators and fans while delivering a great user experience.
Build and own backend services, APIs, and customer-facing features for Astro Private Cloud to provision, configure, and operate Airflow environments at scale.
An opportunity for a motivated student to join a development team as a Software Engineer Intern and work on Angular front-ends and C# backend services while leveraging AI development tools.
Be the Forward Deployed Engineer who owns customer integrations, shapes product direction, and ensures stablecoin payments integrate reliably with partners at an early-stage NYC startup.
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
