Engineering Manager, Inference

Mistral AI is seeking an Engineering Manager for its Inference API team in New York. The role involves leading a team to advance the company’s inference stack through enterprise feature development, API format alignment, and modality improvements including audio and OCR. Work occurs in a fast-paced setting that requires scaling the team while managing project priorities and cross-group coordination.

Responsibilities

• Remove obstacles to enable the team to focus on solution development.
• Convert product vision into implemented technical features through direct collaboration with the Product team.
• Maintain performance, stability, and responsiveness of applications.
• Enforce code quality standards via code reviews, testing, and automation processes.
• Manage the complete software development lifecycle from initial design through deployment.
• Develop project plans that include roadmaps, deadlines, and task assignments.
• Coordinate with stakeholders from Engineering, Product, and Design groups.
• Support team expansion by handling hiring, onboarding, and mentorship activities.

Requirements

• Experience building and managing engineering teams.
• Proficiency in Python and at least one web framework such as FastAPI, Django, or Flask.
• Proficiency in C#, Golang, or TypeScript along with at least one associated web framework.
• Experience with large-scale distributed systems.
• Experience working with cross-functional teams including Product, Design, and Business groups.
• Knowledge of databases, caching mechanisms, and messaging systems.

Benefits

• Comprehensive benefits package covering well-being, growth, and work-life balance, with variations by country that may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.
• Access to the most current benefits details for the New York location via the company Benefits page.