Senior Software Engineer – AI Platform

Coinbase

Senior Software Engineer on the AI Platform team building and operating LLM and agent infrastructure. Leading initiatives to scale AI capabilities across Coinbase.

Posted 7/6/2026full-timeRemote • California • 🇺🇸 United StatesSenior💰 $186,065 - $218,900 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in building and optimizing ML/AI infrastructure, particularly in LLM systems and distributed platform services. Proven ability to lead cross-functional initiatives and partnerships to deliver high-impact, governed AI solutions.

Highest-signal resume keywords

ML/AI Infrastructure DevelopmentLLM Systems ExpertisePython ProgrammingCross-Functional PartnershipCost Optimization

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Software EngineeringLLM Orchestration PatternsAgent FrameworksVector DatabasesModel Serving InfrastructureAPI DevelopmentMicroservicesRuntime EnvironmentsGenerative AI UtilizationTechnical Design

Soft Skills

LeadershipCollaborationCommunicationStrategic ThinkingProblem Solving

Tools & Technologies

MicroVM SandboxesGoverned MCP GatewayKnowledge Base InfrastructureEvaluation ToolingObservability Tooling

Industry Keywords

AI FinOpsSpend AttributionGovernanceProduction-Grade AI SystemsCloud Providers

Tech Stack

Tools & technologies

CloudGoMicroservicesPythonRust

About the role

Key responsibilities & impact

Own the architecture and delivery of core platform systems including the LLM Gateway (60+ models, auth, PII redaction, fallbacks, cost optimization), AI Hub, and agent runtime with microVM sandboxes and governed MCP gateway
Drive the design and implementation of Knowledge Base infrastructure, connecting data sources to auto-provisioned vector and markdown stores queryable by any agent
Lead AI FinOps capabilities including spend attribution, governance, and cost optimization across all AI workloads company-wide
Partner across engineering, security, legal, finance, product, and external partners at frontier labs and major cloud providers to ship high-impact platform capabilities
Build evaluation and observability tooling including LLM-as-judge harnesses, full tracing, and feedback loops that let subject matter experts refine production agents
Shape applied AI strategy by embedding with teams to build production agents, applying fine-tuning and traditional ML where it outperforms prompting

Requirements

What you’ll need

5+ years of software engineering experience with demonstrated expertise building ML/AI infrastructure, LLM systems, or distributed platform services at scale
Demonstrated ability to lead multi-quarter initiatives end-to-end, from technical design through production operation, with measurable platform-wide impact
Deep expertise in LLM orchestration patterns, agent frameworks, vector databases, and model serving infrastructure across multiple providers
Proven track record of cross-functional partnership with security, legal, and product teams to ship governed, production-grade AI systems
Fluency in Python and at least one systems language (Go, Rust, or C++), with production experience building APIs, microservices, and runtime environments
Utilizes generative AI responsibly, maintaining human oversight to deliver business-ready outputs and drive measurable improvements in workflow efficiency, cost, and quality.

Benefits

Comp & perks

Health insurance
Dental insurance
Vision insurance
401(k) matching