Job Description
The role involves designing, implementing, and maintaining a high-performance, large-scale distributed batch compute engine to support Aurora's autonomous vehicle software development, focusing on resource scheduling, workflow management, and system resilience.
Key Responsibilities
- Design, implement, and maintain core components of the distributed batch compute engine BatchAPI.
- Architect and optimize the scheduler, resource allocator, and execution engine to handle heterogeneous workloads efficiently.
- Develop low-latency APIs and resilient communication protocols connecting the Python SDK with the core engine.
- Create high-level workflow abstractions for defining, deploying, and managing complex data processing, simulation, and ML training pipelines.
- Solve complex distributed computing problems such as locking, throttling, and fair-share scheduling to ensure multi-tenant stability.
- Drive continuous improvements in performance, scalability, and resilience of the compute infrastructure, including monitoring and alerting systems.
- Collaborate with infrastructure and product engineering teams to gather requirements, provide expertise, and integrate compute workflows.
Requirements
- Five years of professional software engineering experience.
- Deep expertise in Golang for core systems and Python for SDK API layering.
- Strong understanding of distributed systems fundamentals, including CAP theorem, consensus algorithms, or gossip protocols.
- Experience with performance profiling and tuning, such as memory management, I/O bottlenecks, or network latency optimization.
- Specialized knowledge of container orchestration systems like Kubernetes.
- Proven track record of driving continuous performance, scalability, and resilience improvements in production environments managing critical data.
- Familiarity with cloud provider compute and data services, such as AWS EKS, S3, and RDS.
Benefits & Perks
Base salary range: 146,000 - 234,000 USD per year
Annual bonus eligibility
Equity compensation
Hybrid work environment with in-office presence at least 3 days per week
Commitment to safety policies
Inclusive workplace policies and accommodations for disabilities
Ready to Apply?
Join Aurora and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More jobs at Aurora
Software Engineer, Behavior Planning ML Platform
Aurora
NEW
Pittsburgh
Full Time
1h
$126k-181k
Software Engineer, Mapping
Aurora
NEW
Seattle
Full Time
2d
$162k-260k
Software Test Engineer II
Aurora
NEW
Pittsburgh
Full Time
2d
$94k-137k
More jobs in Pittsburgh, Pennsylvania
Client Solutions Manager Sales and Business Development
res
Pittsburgh
Full Time
Mar 25
Shift Supervisor
Jushi
Pittsburgh
Full Time
Mar 21
Patient Care Consultant
Jushi
Pittsburgh
Full Time
Mar 18