T
Talent@ Beta
Fireworks AI

Member of Technical Staff, Software Engineer

Fireworks AI · Series C · Website

Role Details

Location
New York
Salary (est. USD)
~$180K - $280K (est. USD)

Estimated based on role seniority, company stage (Series C), and industry benchmarks. Actual compensation may vary.

How is this calculated?
Seniority band Staff / Principal
Base range $180K – $280K

Based on Web3 & AI industry compensation data. Seniority is inferred from role title keywords. Company stage affects ranges: early-stage (−15%), late-stage/public (+10%).

Department
Engineering
Type
Full-time
Vertical
AI

Job Description

About Us:

At Fireworks, we’re building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We’ve been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We’re an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.

The Role

You’ll help build the core systems powering Fireworks AI — from customer-facing APIs and product features to the distributed infrastructure running AI workloads at scale.

This is a true full-stack backend + infra role. You’ll design systems, ship product, and own everything end-to-end, not just tickets.

What You’ll Work On

  • APIs, web backend, and developer tooling
  • Model training, fine-tuning, and inference orchestration
  • Job scheduling, autoscaling, and model serving
  • Billing, enterprise features, and access control
  • Cross-cloud infrastructure (compute, storage, networking)
  • Global scale GPU cluster management

What You’ll Do

  • Build and scale backend services and distributed systems
  • Own systems from design → production → reliability
  • Work directly with customers to solve real problems
  • Optimize performance, cost, and developer experience
  • Move fast and use AI tools to automate everything you can

You Might Be a Fit If

  • You cannot wait to jump into the forefront of AI revolution
  • You like to build infrastructure and backend that are directly contributing to products
  • You think in systems, tradeoffs, and impact
  • You take ownership and drive things across teams

Requirements

  • 5+ years building backend or infrastructure systems
  • Strong distributed systems fundamentals
  • Experience with cloud (AWS/GCP/Azure)
  • Familiar with ML/AI tooling or platforms
  • Comfortable working with both humans and AI systems

Bonus

  • Experience with large-scale ML infrastructure
  • Kubernetes / cloud-native stack
  • Infra-as-code, CI/CD, or open-source contributions

Total compensation for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package. Base salary is determined by a range of factors including individual qualifications, experience, skills, interview performance, market data, and work location. The listed salary range is intended as a guideline and may be adjusted.

Base Pay Range (Plus Equity)
$175,000$220,000 USD

Why Fireworks AI?

  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
  • Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
  • Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
  • Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.

About Fireworks AI

AI inference cloud platform, founded by the PyTorch team.

View company profile

Similar roles at other companies

Staff Software Engineer, Technical Lead
Chef Robotics · Series A · San Francisco
Member of Technical Staff, Backend Engineer, API
Runway · Series D+ · Remote
Senior Software Engineer
Unit Labs · Seed
Software Engineer
Virtuals Protocol · Seed
Software Engineer - Compliance
Rain · Series C · New York, NY
Senior Software Engineer, Custody & Staking
Galaxy Digital · Public · New York

You'll be redirected to the company's application page

Get roles like this daily

Join our Telegram channels for curated job alerts