Explore AI roles · Updated daily

Search curated engineering roles across AI infrastructure, agents, machine learning, and product teams.

Keyboard friendly Save and share roles

Location San Francisco Employment Type Full time Location Type On-site Department Engineering Inference.net is seekin...

Engineer Senior System Engineer Kubernetes

$180k - $250k · Senior Fully remote

Join a leading fintech company thatâs democratizing finance for all. Robinhood Markets was founded on a simple idea...

Scientist Data Science Senior Spark

$187k - $220k · Senior Fully remote

Base is planning to bring a million developers and a billion users onchain. We need your help to make that happen. Th...

Stats Senior Airflow

$243k - $286k · Senior Fully remote

Join a leading fintech company thatâs democratizing finance for all. Robinhood Markets was founded on a simple idea...

Infrastructure Ai Engineer Dev

$157k - $185k · Senior Fully remote

Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions fl...

Dev Senior Java Kubernetes

$65k* · Senior Fully remote

Work with the Fundamental AI Research Team to produce high impact AI research. Responsibilities: Lead, collaborate, a...

Scientist Solana Python

$105k - $124k* · Senior Fully remote

Architect and implement efficient ML Inference pipelines for large language models. Responsibilities: Design and impl...

Engineer Aws Kubernetes Solana

$103k - $115k* · Senior Fully remote

Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions fl...

Ai Analyst Operations

$124k* · Senior Fully remote

The roleWe've built a product customers love, and we can't fully keep up with customer demand. We need a talented, am...

Engineer Dev Java Javascript

$106k - $114k* · Senior Fully remote

Genies is an AI avatar and games technology company powering the next generation of digital experiences. Genies' tech...

Dev Full Stack Intern Entry Level

$40k - $55k · Senior Fully remote

Join a leading fintech company thatâs democratizing finance for all. Robinhood Markets was founded on a simple idea...

Engineer Machine Learning Ai Kubernetes

$157k - $185k · Senior Fully remote

Join a leading fintech company thatâs democratizing finance for all. Robinhood Markets was founded on a simple idea...

Scientist Data Science Python

$187k - $220k · Senior Fully remote

Join a leading fintech company thatâs democratizing finance for all. Robinhood Markets was founded on a simple idea...

Scientist Stats Data Science Engineer

$161k - $190k · Senior Fully remote

Join a leading fintech company thatâs democratizing finance for all. Robinhood Markets was founded on a simple idea...

Infrastructure Ai Engineer Senior

$187k - $220k · Senior Fully remote

Kickstarter is seeking an experienced Senior Data & Analytics Engineer II to join our Insights team. There is a treme...

Stats Engineer Senior Python

$175k - $191k · Senior Fully remote

Want to change the world? We’re a hypergrowth AI startup backed by top-tier VC firms. We’ve created a new paradi...

Engineer Senior Dev Java

$106k - $114k* · Senior Fully remote

Your Role: As a Staff Software Engineer, you will be responsible for designing, implementing, and maintaining the sys...

Api Engineer Dev Aws

$98k - $100k* · Senior Fully remote

Join a leading fintech company thatâs democratizing finance for all. Robinhood Markets was founded on a simple idea...

Scientist Data Science Python R

$187k - $220k · Senior Fully remote

Join a leading fintech company thatâs democratizing finance for all. Robinhood Markets was founded on a simple idea...

Engineer Senior Dev Aws

$187k - $220k · Senior Fully remote

Join a leading fintech company thatâs democratizing finance for all. Robinhood Markets was founded on a simple idea...

Ai Engineer Dev Aws

$157k - $185k · Senior Fully remote

Selected role

Senior Distributed System Engineer

Kuzco San Francisco, CA, USA

$180k - $250k Senior Full-time

Location

San Francisco

Employment Type

Full time

Location Type

On-site

Department

Engineering

Inference.net is seeking a Senior Distributed ML Systems Engineer to join our team. This role involves developing large-scale, fault-tolerant distributed systems that handle millions of large language model inference requests per day. If you are passionate about developing next-generation ML systems that operate at scale, we want to hear from you.

You will be responsible for designing and implementing the core systems that power our globally distributed LLM inference network. You'll work on problems at the intersection of distributed systems, machine learning, and resource optimization.

About Inference.net

We are building a distributed LLM inference network that combines idle GPU capacity from around the world into a single cohesive plane of compute that can be used for running large-language models like DeepSeek and Llama 4. At any given moment, we have over 5,000 GPUs and hundreds of terabytes of VRAM connected to the network.

We are a small, well-funded team working on difficult, high-impact problems at the intersection of AI and distributed systems. We primarily work in-person from our office in downtown San Francisco. Our investors include A16z CSX and Multicoin. We are high-agency, adaptable, and collaborative. We value creativity alongside technical prowess and humility. We work hard, and deeply enjoy the work that we do.

Key Responsibilities

Design and implement scalable distributed systems for our inference network
Develop models for efficient resource allocation across a network of heterogeneous hardware and quickly changing topology
Optimize network latency, throughput, and availability
Build robust logging and metrics systems to monitor network health and performance
Conduct reviews of architecture and system design to ensure use of best practices
Collaborate with founders, engineers, and other stakeholders to improve our infrastructure and product offerings

What We're Looking For

Very strong problem-solving skills and ability to work in a startup environment
5+ years of experience in building high performance systems
Strong programming skills in Typescript, Python, and one of Go, Rust, or C++
Solid understanding of distributed systems concepts
Knowledge of orchestrators and schedulers like Kubernetes and Nomad
Use of AI tooling in development workflow (ChatGPT, Claude, Cursor, etc)
Experience with LLM inference engines like vLLM or TensorRT-LLM is plus
Experience with GPU programming and optimization (CUDA experience is a plus)
Experience with Postgres or NATS.io is a bonus

Compensation

We offer competitive compensation, equity in a high-growth startup, and comprehensive benefits. The base salary range for this role is $180,000 - $250,000, plus equity and benefits, depending on experience.

Equal Opportunity

Inference.net is an equal opportunity employer. We welcome applicants from all backgrounds and don't discriminate based on race, color, religion, gender, sexual orientation, national origin, genetics, disability, age, or veteran status.

Showing 4441–4460 of 4,725 AI roles

1 … 221 222 224 225 237

Find your next AI role

Senior Distributed System Engineer

Senior Data Scientist, Brokerage

Senior Manager, Analytics Engineering

Software Engineer, AI Infrastructure

Sr. Manager, Software Engineering

Full TimeResearch Scientist

Full TimeML Ops Engineer

Product Analyst - AI Governance and Product Operations

Software Engineer II

Full Stack Web Developer Intern

Machine Learning Engineer, Applied ML

Data Scientist- Customer Lifecycle and Engagement

Senior Data Scientist, Analytics Engineer

Senior Software Engineer, AI Infrastructure

Senior Data Analytics Engineer II

Senior Software Engineer

Staff Software Engineer - Trading API

Data Scientist, Credit Cards

Senior Software Engineer, Data Compute Platform

Software Engineer, Agentic AI