Job Description
The role involves designing, implementing, and maintaining a high-performance, large-scale distributed batch compute engine to support Aurora's autonomous vehicle software development, focusing on optimizing resource scheduling, workflow management, and system resilience.
Key Responsibilities
- Design, implement, and maintain core components of the distributed batch compute engine BatchAPI.
- Architect and optimize the scheduler, resource allocator, and execution engine of BatchAPI.
- Develop low-latency APIs and communication protocols connecting the Python SDK with the core engine.
- Create high-level workflow abstractions for defining, deploying, and managing complex data, simulation, and ML pipelines.
- Solve distributed computing challenges such as locking, throttling, and fair-share scheduling to ensure multi-tenant stability.
- Improve performance, scalability, and resilience of the compute infrastructure through continuous development and monitoring.
- Collaborate with infrastructure and product teams to gather requirements and integrate compute workflows with company systems.
Requirements
- 5 years of professional software engineering experience.
- Deep expertise in Golang for core systems and Python for SDK API layering.
- Strong understanding of distributed systems fundamentals such as CAP theorem, consensus algorithms, or gossip protocols.
- Experience with performance profiling and tuning, including memory management, I/O bottlenecks, or network latency optimization.
- Specialized knowledge of container orchestration systems like Kubernetes.
- Proven track record of driving continuous performance, scalability, and resilience improvements in production environments managing critical data.
- Familiarity with cloud provider compute and data services such as AWS EKS, S3, and RDS.
Benefits & Perks
Salary range of $162,000 - $260,000 per year
Annual bonus
Equity compensation
Hybrid work environment with in-office presence at least 3 days per week
Safety policies and a culture emphasizing safety and trust
Inclusion and diversity policies, including accommodations for disabilities and protected classes
Ready to Apply?
Join Aurora and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More at Aurora
More jobs at Aurora
Facilities Technician Lead
Aurora
NEW
Pittsburgh
Full Time
21h
$83k-107k
Senior Manager, Government Relations
Aurora
Washington
Full Time
4d
$162k-234k
Software Test Engineer
Aurora
Pittsburgh
Full Time
4d
$112k-180k
More jobs in Mountain View, California
Software Technical Program Manager, Functional Safety
Nuro
Mountain View
Full Time
Mar 28
$132k-198k
NPI Alignment Engineer
Aeva
Mountain View
Full Time
Mar 25
Senior ML Research Scientist, VLM VLA
Nuro
Mountain View
Full Time
Mar 25
$184k-276k