Responsibilities
Design, develop, and deploy machine learning infrastructure for ads training and serving systems.
Optimize training and serving throughput, cost, latency, GPU and accelerator utilization, and tail latency.
Build real-time feature processing infrastructure, including low-latency pipelines, online feature stores, and streaming update paths.
Lead infrastructure for a real-time sequential foundation model, including long-context serving and evolving-data training pipelines.
Collaborate with product managers, data scientists, machine learning engineers, and the ML Foundation team to co-design systems.
Identify system and operational shortcomings to improve availability and stability.
Mentor engineers, set technical direction, and conduct code reviews.
Requirements
Master’s or PhD in computer science, artificial intelligence, machine learning, operations research, or equivalent self-study and experience.
At least 3 years of industry experience building ML infrastructure or applying machine learning to real-world problems with large datasets.
Deep expertise building, scaling, and managing production ML infrastructure for training and/or serving, with strong MLOps knowledge.
Strong software engineering skills, such as Python or Go, plus experience with SQL, Spark, Pandas, Torch, TensorFlow, and XGBoost.
Strong analytical, problem-solving, communication, and cross-functional collaboration skills.
Preferred: 5+ years of industry experience technically leading teams building ML infrastructure or solving machine learning problems.
Preferred: experience with training and serving efficiency, real-time feature processing, Kafka, Flink, online feature stores, low-latency retrieval, sequential modeling, transformer architecture, recommendation systems, large foundation models, digital advertising platforms, LLM integrations, prompt engineering, and productivity tooling.
Benefits
Flex First remote work arrangement, allowing employees to work from home, an office, or another preferred location, with regular in-person events.
Market-competitive location-based base compensation.
Eligible for a new hire equity grant and annual refresh grants.
Benefits offerings are available; details are provided through the company benefits materials.