Job Description
The role involves designing, implementing, and maintaining a high-performance, large-scale distributed batch compute engine to support Aurora's autonomous vehicle software development, focusing on optimizing resource scheduling, workflow management, and system resilience.
Key Responsibilities
- Design, implement, and maintain core components of the distributed batch compute engine BatchAPI.
- Architect and optimize the scheduler, resource allocator, and execution engine of BatchAPI.
- Develop low-latency APIs and communication protocols connecting the Python SDK with the core engine.
- Create high-level workflow abstractions for defining, deploying, and managing complex data, simulation, and ML pipelines.
- Solve distributed computing challenges such as locking, throttling, and fair-share scheduling to ensure multi-tenant stability.
- Improve performance, scalability, and resilience of the compute infrastructure through continuous development and monitoring.
- Collaborate with infrastructure and product teams to gather requirements and integrate compute workflows with company systems.
Requirements
- 5 years of professional software engineering experience.
- Deep expertise in Golang for core systems and Python for SDK API layering.
- Strong understanding of distributed systems fundamentals such as CAP theorem, consensus algorithms, or gossip protocols.
- Experience with performance profiling and tuning, including memory management, I/O bottlenecks, or network latency optimization.
- Specialized knowledge of container orchestration systems like Kubernetes.
- Proven track record of driving continuous performance, scalability, and resilience improvements in production environments managing critical data.
- Familiarity with cloud provider compute and data services such as AWS EKS, S3, and RDS.
Benefits & Perks
Salary range of $162,000 - $260,000 per year
Annual bonus
Equity compensation
Hybrid work environment with in-office presence at least 3 days per week
Safety policies and a culture emphasizing safety and trust
Inclusion and diversity policies, including accommodations for disabilities and protected classes
Ready to Apply?
Join Aurora and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More at Aurora
More jobs at Aurora
Identity Access Management Architect
Aurora
NEW
Pittsburgh
Full Time
15h
$191k-277k
Identity Access Management Architect
Aurora
NEW
Seattle
Full Time
15h
$212k-307k
Identity Access Management Architect
Aurora
NEW
San Francisco
Full Time
15h
$212k-307k
More jobs in Mountain View, California
IT Support Engineer Temporary FTE
Nuro
NEW
Mountain View
TEMPORARY
15h
$96k-130k
Software Engineer, Onboard Infrastructure
Nuro
NEW
Mountain View
Full Time
15h
$160k-241k
Software Engineer, Offboard Infrastructure
Nuro
NEW
Mountain View
Full Time
15h
$160k-241k