AI Work Central
For you AlertsAlerts
WeekdayOpen · Source checked

ML Infrastructure and Performance Engineer, AI Expert (Remote)

$90 to $120/hr

Listed rate, USDFull-timeCodingUS only

Free: we never charge you to search or apply. The button opens this role on Weekday's own site.

Get roles that fit you by email. Free.

Email me roles that fit

Other open Coding roles

Each is open in at least one country this role lists. Newest first. See the full list

Can I apply from my country?

United States only

  • United States

Key details

Location
United States, remote
Contract type
Full-time
Time
40 h/week
Language
English
Field
Coding
  1. Posted on Weekday
  2. Last checked

Listed on Weekday since 13 Nov, last checked 15 Nov.

Weekday posts this role for a client and does not say which company it is.

Entry: open · 89 roles today · checked 15 November 2026

In plain words

What you will do
We are seeking an experienced ML Infrastructure and Performance Engineer to contribute to the development and advancement of next-generation Generative AI systems. from the Weekday listing
Who can apply
The listing is open to people in United States.
Pay and time
$90 to $120/hr as listed, full-time work, remote. Candidates must be available for a full-time commitment of 40 hours per week , with no conflicting professional engagements. from the Weekday listing

What you'll do

This role is for one of our clients

Compensation: $90 - $120 per hour

Location: Remote

Job Overview

We are seeking an experienced ML Infrastructure and Performance Engineer to contribute to the development and advancement of next-generation Generative AI systems. This role is focused on building, optimizing, debugging, and evaluating the infrastructure that powers large language models and other frontier AI systems.

The ideal candidate will have hands-on experience in ML systems engineering, accelerator performance optimization, distributed workloads, or large-scale model serving. Expertise in areas such as custom accelerator kernels, performance profiling, trace analysis, distributed systems debugging, and high-throughput inference is particularly valuable. Experience with JAX, XLA, and TPU-based infrastructure will be a strong advantage.

In this role, you will apply your engineering expertise to create, evaluate, and improve technical tasks and solutions used to train and assess advanced AI models. Your work will help improve how frontier AI systems understand and solve complex ML infrastructure and performance engineering problems.

This is a fully remote opportunity open to candidates worldwide. The engagement will be structured in accordance with applicable local employment and compliance requirements. Candidates must be available for a full-time commitment of 40 hours per week, with no conflicting professional engagements.

Requirements

Key Responsibilities

  • Design challenging technical tasks covering accelerator kernel development, performance profiling, distributed workload debugging, and high-throughput inference serving.
  • Develop complex and adversarial engineering problems that test the capabilities of advanced AI models, including tasks involving accelerator programming and optimization.
  • Create accurate, technically sound reference solutions that demonstrate best practices in ML systems engineering.
  • Evaluate AI-generated solutions for correctness, efficiency, scalability, and practical applicability.
  • Develop detailed technical guidelines and assessment rubrics for kernel optimization, profiler interpretation, distributed systems, and inference performance.
  • Analyze performance bottlenecks across ML infrastructure, compilers, accelerators, and model-serving systems.
  • Provide clear, structured technical feedback to help improve AI model capabilities in ML systems and infrastructure engineering.
  • Collaborate with researchers and fellow subject matter experts to maintain the quality, consistency, and accuracy of AI training and evaluation data.

Required Qualifications

  • At least 2 years of hands-on professional experience in ML systems, ML infrastructure, model serving, accelerator performance engineering, or a closely related field.
  • Practical experience in at least one of the following areas:
    • Accelerator Kernel Programming: Developing or optimizing custom kernels using Pallas, Triton, CUDA, CUTLASS, or similar technologies.
    • Performance Profiling: Working with profiling and trace-analysis tools such as JAX/XLA Profiler, Kineto, torch.profiler, or NVIDIA Nsight.
    • Distributed Workload Debugging: Identifying and resolving performance and execution issues in distributed or accelerator-intensive workloads.
    • LLM Inference Serving: Experience with vLLM, SGLang, TensorRT-LLM, JetStream, KV cache optimization, paged attention, or continuous batching.
  • Production-level experience with JAX and/or PyTorch.
  • Understanding of modern accelerator architectures, including TPUs (v4-v6e), NVIDIA H100/B200, AWS Trainium, or AMD MI300.
  • Ability to analyze and optimize throughput, latency, memory utilization, and computational efficiency.
  • Demonstrable professional growth and career progression in engineering or infrastructure-focused roles.
  • Availability to commit at least 40 hours per week on weekdays.
  • Excellent written communication skills, with the ability to explain complex technical concepts and engineering decisions clearly.

Preferred Qualifications

  • Experience with JAX, XLA, and TPU-based development environments.
  • Knowledge of custom operators, sharding, and distributed training frameworks such as pjit, shard_map, FSDP, Megatron, or MaxText.
  • Familiarity with compiler and graph-level technologies such as XLA, StableHLO, torch.compile, and MLIR.
  • Experience developing performance benchmarks, technical evaluation frameworks, or engineering assessment rubrics.
  • Exposure to AI model evaluation, synthetic training data generation, or working with frontier AI systems.

Engagement Details

  • Work Arrangement: Fully Remote
  • Geographic Eligibility: Worldwide
  • Commitment: Full-Time, 40 hours per week
  • Schedule: Weekdays
  • Engagement Structure: Employment or engagement through an appropriate local partner, depending on the candidate's country of residence.
  • Availability: Candidates must be able to commit exclusively to this engagement without conflicting professional commitments.

From the Weekday listing, as published.

How to apply

Software Engineering and Coding interview questions

Pay

Listed by Weekday, in USD. Is Weekday legit?

This role All Coding

On a ruler from $0 to $150 an hour: $90 to $120.

Compared with 149 Coding roles with an hourly rate: the median is $70 and half sit between $60 and $95. Midpoint of each listed range, 15 Nov.

Estimate a week at this rate

How this role compares

At $105 an hour (the middle of its listed range), this role is $10 above the median Weekday role, $95 from 71 roles with an hourly rate and $35 above the median Coding role on all platforms, $70 from 149 roles. The medians are the count of our Pay Index on 15 November 2026, with each role counted once.

Entry at Weekday is open: its own job list had open roles when we read it on 15 November 2026.

Similar open roles: Ground Combat & Special Operations SME at micro1, $75 to $130/hr; Sr. Full-Stack Software Engineer at micro1, $50 to $100/hr; Game Developer (Godot Expert) at Weekday, $70 to $130/hr.

Sign in or create an account

No password. The first time, this creates your account.

Continue with Google

Your account emails you up to 5 roles a week that fit your country and field. Don't send me emails

By creating an account you confirm you are 18 or over and accept the terms of use and the privacy notice. Who we are: legal notice.

Settings

Loading your settings