AI tools, scored for your job
Get paid to train AI
Hiring now · posted 104d ago Science Full-time · Remote

Member of Engineering (Inference Infrastructure)

at Poolside

Pay not published

The rate is shared during the application.

Remote · Remote (EMEA) Language: English Posted 15 Jul 2026

About this role

Preparing for this role? See the best AI tools for developers, practise with ready-made prompts for developers, read Is GitHub Copilot Free in 2026? Pricing and Access Guide and take the free 30-day AI challenge.

ABOUT POOLSIDE

In this decade, the world will create Artificial General Intelligence. There will only be a small number of companies who will achieve this. Their ability to stack advantages and pull ahead will define the winners. These companies will move faster than anyone else. They will attract the world's most capable talent. They will be on the forefront of applied research, engineering, infrastructure and deployment at scale. They will continue to scale their training to larger & more capable models. They will be given the right to raise large amounts of capital along their journey to enable this. They will create powerful economic engines. They will obsess over the success of their users and customers.

Poolside exists to be this company: to build a world where AI will be the engine behind economically valuable work and scientific progress. We believe the fastest way to reach AGI lies in accelerating software development itself, by reshaping the developer experience with agentic systems, coding assistants, and the frontier models that power them. We deploy these systems directly into the development environments of security-conscious enterprises.

ABOUT OUR TEAM

We were founded in the US and have our home there, but our team is distributed across Europe and North America. We get our fix of in-person collaboration (and croissants) in Paris each month for 3 days, always Monday-Wednesday, with an open invitation to stay the whole week. We also do longer off-sites once a year.

Our team is a multidisciplinary blend of research, engineering, and business experts. What unites us is our deep care for what we build together. We’re in a race that requires hard work, intellectual curiosity, and obsession; to balance this intensity, we’ve assembled a team of low ego and kind-hearted individuals who have built the special culture Poolside has. By building collaboratively and with intention, we create a compounding effect that moves the entire company forward towards our mission: reaching AGI through intelligence systems built for software development.

ABOUT THE ROLE

You’ll be working in the compute team focusing on GPU workload scheduling and inference serving optimization. You would partner with the inference team to improve our inference throughput and latency for evals and reinforcement learning. You would collaborate with our scalability team to focus on stabilizing our large scale fault tolerant training. You would also be in close contact with the infra team to make sure our GPU nodes are all healthy and fully utilized.

We are one of the key teams to improve the research velocity. Any improvement on our systems has a wide impact on researchers and can contribute to the poolside mission on building a frontier model.

YOUR MISSION

To optimize GPU utilization across the company and to deliver stable and scalable inference serving stack for Poolside’s researchers.

RESPONSIBILITIES

  • Design and develop internal scheduling system to maximize GPU utilization

  • Build API and tooling to help manage the lifecycle of GPU workloads and troubleshoot failures

  • Design and improve inference control plane to speed up model deployment and inference request serving

  • Collaborate with research to improve research velocity continuously

SKILLS & EXPERIENCE

  • Strong programming skills in Go, or other similar languages

  • Strong systems engineering background: distributed systems, schedulers, control planes, or high-throughput data planes.

  • Production experience with Kubernetes internals — controllers, informers, operators — not just deploying to it.

  • Bias toward observability and debuggability: building a system that is easy to navigate when debugging production issues

  • Plus: experience in systems serving large scale inference requests

PROCESS

  • Intro call with a member of our team

  • Technical Interview(s) with one of our Members of Engineering

  • Team fit call with the People team

  • Final interview with one of our Founding Engineers

BENEFITS

  • Fully remote work & flexible hours

  • 37 days/year of vacation & holidays

  • Health insurance allowance for you & dependents

  • 16 weeks of flexible, full-pay parental leave

  • Well-being, always-be-learning & home office allowances

  • Company-provided equipment

  • Frequent team get togethers

  • Diverse & inclusive people-first culture

  • Diverse & inclusive people-first culture

 

This is a remote role. Location as listed by Poolside: Remote (EMEA).

How applying works

  1. Click Apply now and enter your email.
  2. You go straight to the application. We email you a copy of this role and your link.
  3. You apply on Poolside's own careers page. Zekai is not the employer and never charges you.
How to get this job

Your plan for “Member of Engineering (Inference Infrastructure)”

Are you ready? Check what you have

Taken from this listing's own requirements.

0 / 5

What to know before you apply

How to stand out for developers
  • Mirror the job's own wording in your CV: reviewers and screening tools look for the skills listed above.
  • Show real work: a portfolio, GitHub, case study or numbers from past projects beats a long list of duties.
  • Show how you already use AI tools in your work. AI companies hire people who use their products well.
  • Apply early and follow up once, politely, if you hear nothing in two weeks.
Prepare free with Zekai

3 steps to stand out as one of the best developers

  1. 01
  2. 02

    Practise with real prompts

    Many tests ask you to write or judge prompts in your field. Practise on these first.

    Sample Prompt for AI App Prototyping

    Generate a functional prototype for a mobile app called 'PlantPal'. It's for new plant owners. Key Screens: • Onboarding: A simple 3-step intro to the app's features. • Login/Sign-up: Email and password authentication. • My Plant…

    Generate a Function Docstring

    Analyze the following TypeScript function. Write a complete TSDoc comment for it. Explain what the function does, describe each parameter (including its type and purpose), and describe the return value. [[Paste your code here]]

    Prompt library for developers →
  3. 03

    Take the free 30-day AI challenge

    Five minutes a day to get confident with AI in your own work. Day 1 is open now, no card needed.

    Start Day 1 free →

    Guides for developers

Developers

More paid AI roles for developers

Confidential clientAI training · Developers

Software Engineering Specialist

Top pay
  • Remote · United States, United Kingdom +1
  • Contract · flexible hours

Our partner is engaging Software Engineering Specialists to contribute technical expertise to a customer project focu…

$150–$350/hr
33d ago
Confidential clientAI training · Developers

Senior Software Engineering Experts

NewTop pay
  • Remote · United States
  • Contract · flexible hours

Our partner is working with a leading AI research lab on a project to improve how AI systems do real-world software e…

$120–$180/hr
New today
Confidential clientAI training · Developers

Open Source Contributor (GitHub)

Top pay100 open
  • Remote · Worldwide
  • Contract · flexible hours

We are looking for highly skilled Open-Source Software Engineers to contribute to an AI training project involving so…

$100–$150/hr
41d ago
Confidential clientAI training · Developers

Software Engineer — Agentic Search Systems

Top pay
  • Remote · United States
  • Contract · flexible hours

We're looking for engineers who have shipped production search systems (especially agentic ones now that we're in the…

$80–$150/hr
88d ago
Confidential clientAI training · Developers

Software Engineering Expert

Top pay
  • Remote · United States
  • Contract · flexible hours

The research teams behind the best-known AI models come to our partner for software engineering judgment they can't g…

$70–$150/hr
43d ago
Confidential clientAI training · Developers

Frontend Engineer Talent Network

Top pay
  • Remote · United States
  • Contract · flexible hours

Join our Frontend Engineer Expert Network to connect with leading AI labs and companies seeking your expertise. This …

$70–$150/hr
249d ago
new in the last 24 hours

New roles in your inbox every morning

Pick your field. One short email a day, only when new roles open. Unsubscribe any time.

Roles come from public listings and change daily. Pay is what the listing shows; offers depend on your test, experience and country. If you join through a Zekai link, the platform may pay Zekai a fee. Your pay stays the same.

Member of Engineering (Inference Infrastructure)
Get paid to train AI →

See Zekai first in Google