About J.P. Morgan As a Senior Lead Software Engineer within the AI and Machine Learning Platform team, you will build and scale AI infrastructure that modernizes traditional infrastructure management and site reliability engineering through applied AI. You will own the reliability, performance, and cost-efficiency of the LLM inference platform end-to-end. You will operate LLM serving stacks in production at scale, with deep instrumentation and strong operational rigor. You will partner across engineering teams to deliver secure software, improve stability, and lead incident response and continuous improvement.

Responsibilities - Design, develop, troubleshoot, and deliver secure, production-grade software and services for AI infrastructure - Build backend services and APIs enabling reliable operation of AI infrastructure in production - Operate and scale LLM serving infrastructure, including model hosting, request routing, batching, and cache op

About J.P. Morgan As a Senior Lead Software Engineer within the AI and Machine Learning Platform team, you will build and scale AI infrastructure that modernizes traditional infrastructure management and site reliability engineering through applied AI. You will own the reliability, performance, and cost-efficiency of the LLM inference platform end-to-end. You will operate LLM serving stacks in production at scale, with deep instrumentation and strong operational rigor. You will partner across engineering teams to deliver secure software, improve stability, and lead incident response and continuous improvement.

Responsibilities - Design, develop, troubleshoot, and deliver secure, production-grade software and services for AI infrastructure - Build backend services and APIs enabling reliable operation of AI infrastructure in production - Operate and scale LLM serving infrastructure, including model hosting, request routing, batching, and cache op