Machine Learning Systems Engineer, Model Evaluations

Machine Learning Systems Engineer, Model Evaluations

Join to apply for the Machine Learning Systems Engineer, Model Evaluations role at Anthropic

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We aim for AI to be safe and beneficial for users and society. Our team is a growing group of researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

The Role

We seek a Machine Learning Systems Engineer for our Model Evaluations team. You will develop scalable systems for model evaluation and research inference, collaborating with researchers to improve workflows and infrastructure, impacting the advancement of safe and responsible AI.

Responsibilities

• Design and maintain Model Evaluations infrastructure for testing and assessment
• Develop APIs and infrastructure for Research Inference
• Create data pipelines for research data processing
• Implement monitoring and performance optimization
• Build user interfaces and tools for evaluation workflows
• Collaborate with research teams to meet their needs
• Enhance system performance and scalability
• Participate in on-call rotations and deliver operational code
• Document systems for broader adoption

Qualifications

• 3+ years of software engineering experience
• Experience with data infrastructure and large datasets
• Proficiency in Python and cloud platforms (AWS, GCP)
• Ability to work independently and communicate effectively
• Interest in societal impacts of AI and responsible development

Preferred Skills

• Experience with high-performance ML systems, GPUs, Kubernetes, PyTorch
• Building evaluation frameworks, distributed systems, real-time inference
• Infrastructure as Code, CI/CD pipelines

Additional Details

Salary range: $300,000 - $405,000 USD

Education: Bachelor’s degree or equivalent

Location: Hybrid policy, 25% in-office in SF preferred

Visa sponsorship available

We encourage diverse applicants and value impact and collaboration. Join us in advancing impactful, trustworthy AI research.

#J-18808-Ljbffr