MLOps Engineer

Evlo AI

Remote

About The Role

The role sits at the intersection of ML and platform engineering, owning the infrastructure that takes models from a data scientist's notebook to reliable, monitored, cost-efficient production systems serving real traffic.

This is a high-leverage position: the MLOps engineer builds the CI/CD pipelines, feature stores, model registries, and observability tooling that every ML team depends on, directly determining how fast the organization ships and how reliably its models run.

Key Responsibilities

  • Design and maintain CI/CD pipelines for ML workloads using tools like GitHub Actions, GitLab CI, or Airflow, with automated testing and staged rollout gates for model releases
  • Build and operate model serving infrastructure on Kubernetes (EKS/GKE) using KServe, Seldon, or Triton Inference Server, optimizing for latency, autoscaling, and GPU utilization
  • Implement model monitoring and observability: data drift detection, latency/throughput dashboards, and automated alerting via Prometheus, Grafana, and Evidently
  • Establish model versioning and lineage using MLflow or a comparable model registry, ensuring reproducibility of training runs and clean promotion workflows from staging to production
  • Engineer scalable data and feature pipelines with Spark, Kafka, or dbt, coordinating with data engineering on feature store architecture (Feast, Tecton, or custom)
  • Automate infrastructure as code with Terraform and manage ML platform components across AWS, GCP, or Azure
  • Drive cost optimization across training and inference workloads, including spot instance strategies, batching, and GPU right-sizing

What We Are Looking For

  • 3–7 years of experience in MLOps, ML engineering, or platform/SRE roles supporting ML workloads in production
  • Strong Python and software engineering fundamentals; comfort owning services end-to-end, not just glue code
  • Deep hands-on experience with Kubernetes, Docker, and at least one major cloud (AWS, GCP, or Azure)
  • Production experience with model serving and orchestration tools (MLflow, KServe, Kubeflow, Airflow, or SageMaker Pipelines)
  • Solid grasp of ML fundamentals sufficient to reason about training pipelines, model evaluation, and drift — no need to build models from scratch, but must speak the language
  • Experience with IaC (Terraform), observability stacks (Prometheus/Grafana/Datadog), and incident response practices
  • Bachelor's degree in CS, Engineering, or equivalent practical experience. Bonus: experience with GPU infrastructure and inference optimization (vLLM, TensorRT, quantization), feature stores at scale, or building internal ML platforms used by multiple teams

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.