FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and orchestrating API-based products with a focus on low-latency and high-reliability systems. Proficient in cloud infrastructure and developer-facing platforms, with a strong understanding of AI integration and enterprise-grade features.
Highest-signal resume keywords
Backend Engineering ExperienceProficiency In Go And/or RustCloud Infrastructure SkillsExperience With LLM Provider APIsBuilding API Gateways Or Proxies
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
API DevelopmentDistributed SystemsHigh-Throughput APIsRate LimitingAuthenticationUsage MeteringAudit LoggingKubernetesTerraformPostgres
Soft Skills
Product-Oriented MindsetComfort With Ambiguity
Tools & Technologies
AWSGCPRedisBifrostKongEnvoyTykStripeMetronomeOrb
Industry Keywords
SOC 2 ComplianceML InfrastructureModel ServingEvaluation FrameworksMulti-Tenancy
Tech Stack
Tools & technologiesAWSCloudDistributed SystemsGoGoogle Cloud PlatformKubernetesPostgresRedisRustTerraform
About the role
Key responsibilities & impact- Build and orchestrate API-based products from the ground up. Design and implement low-latency, high-reliability APIs for leaderboards, models, and arenas.
- Ship enterprise-grade infrastructure. Build the systems enterprise customers expect: rate limiting, authentication, usage metering, cost attribution, audit logging, and SOC 2 compliance.
- Build deep observability. Instrument infrastructure with distributed tracing, latency breakdowns, token-level usage tracking, and real-time dashboards so customers (and we) can see exactly what's happening.
- Build AI-centered products. Integrate with our core evaluation platform, Arena data, and customer-specific benchmarks. Collaborate with the research team to turn novel ideas into full-featured products.
Requirements
What you’ll need- 6+ years of backend engineering experience, with meaningful time spent on distributed systems, infrastructure, or developer-facing platforms.
- Strong proficiency in Go and/or Rust, with hands-on experience building high-throughput APIs or proxy/gateway systems.
- Experience with LLM provider APIs (OpenAI, Anthropic, Google, etc.) and a working understanding of the challenges: streaming, token management, rate limits, model-specific quirks.
- Solid cloud infrastructure skills — you're comfortable with AWS or GCP, Kubernetes, Terraform, and database systems like Postgres and Redis.
- A product-oriented mindset. You think about the developer experience of your APIs, not just the implementation. You ask "why" before "how."
- Comfort with ambiguity. We're a startup. Scope is fluid, context shifts, and you'll wear many hats. That should sound exciting, not stressful.
- Nice to Have
- Experience building API gateways, proxies, or developer tools (Bifrost, Kong, Envoy, Tyk, or custom).
- Background in ML infrastructure, model serving, or evaluation frameworks.
- Experience building enterprise-ready features: SSO, RBAC, audit logs, multi-tenancy.
- Experience building billing infrastructure around systems like Stripe, Metronome and Orb
- Familiarity with the modern AI infra stack (vLLM, LiteLLM, LangChain, etc.)
Benefits
Comp & perks- We offer competitive compensation and equity aligned to the markets where our team members are based. The base salary range will depend on the candidate’s permanent work location.
- Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
- The opportunity to work on cutting-edge AI with a small, mission-driven team
- A culture that values transparency, trust, and community impact