Principal Research Engineer - Multimodal AI - Microsoft Research AI Frontiers

Microsoft Research (MSR)AI Frontierslab is seeking applications for the position ofPrincipalResearchEngineer-Multimodal AIto join their team inRedmond, WA or New York City, NY.

We areseeking aPrincipalResearchEngineer-MultimodalAIto join our team and leadengineeringefforts on the advancement of Generative AI and Multimodal Model (MLM) technologies.As aPrincipalResearchEngineer, you will play a crucial role in developing, improving, and exploring the capabilities of Multimodal AIand agenticmodels. Your work will have a significant impact on the development ofcutting-edgetechnologies, advancing state-of-the-artand providing practical solutions to real-world problems.

Our ongoing research areas encompass but are not limited to:

• Reasoning method for Multimodal models
• New multimodal model architectures and training methods
• Action models for automating web and computer tasks
• Orchestration and multi-agent systems: automated orchestration between multiple agents incorporating human feedback and oversight
• Evaluation and Understanding of model and agent capabilities

TheAI Frontierslab atMicrosoft Research ischartedwith ambitious research goals for advancingArtificial Intelligence (AI) capabilities in several key areas including modeling, algorithms,reasoningand agentic AI. Our lab offers a vibrant environment forcutting-edgemultidisciplinary research, includingan openpublication policy and close links to top academic institutions around the world.

At Microsoft, our mission-to empower every person and every organization on the planet to achieve more-guides how we partner with customers to deliver trusted, impactful solutions. With a growth mindset culture, we innovate responsibly and measure success by shared progress-people, teams, and customers. Join us to do meaningful work that changes the world and helps shape what's next for everyone.

• As a Principal Research Engineer in AI Frontiers, you will design, develop, execute, and implement technology research projects in collaboration with other researchers, engineers, and product groups.
• As a member of a word-class research organization, you will be a part of research breakthroughs in the field and play a crucial role in developing, improving, and exploring the capabilities of Large Language Models (LLMs), reasoning and agentic AI.

Required Qualifications

• Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

Preferred Qualifications

• 2+ year(s) experience developing with Python and Pytorch/JAX.
• Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Master's or Doctorate in Computer Science or relevant field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
• Experience with architecture and optimizations for large language models.
• Hands-on work in debugging and profiling Pytorch distributed code.
• Understanding of working of CUDA kernels.
• Experience with pre-training, mid-training and/or post-training pipelines for language and/or multimodal models.
• Foundational understanding of reinforcement learning and key challenges in the field.
• Experience with verl, Ray, Megatron and/or vLLM is a significant plus.
• Any experience in building scalable services can be highly complementary.

#Research