Job Description
A Senior Software Engineer responsible for scaling and improving the reliability of Gridmatic's data infrastructure to support large-scale machine learning models for energy price forecasting and grid optimization in a high-growth renewable energy startup.
Key Responsibilities
- Scale and improve the reliability of data infrastructure for large-scale ML models
- Ingest and process petabyte-scale weather, prices, load, and grid data
- Enhance data pipelines to handle external data source issues such as downtime, late arrivals, and schema changes
Requirements
- Experience in leading the scaling and reliability of data infrastructure, specifically in improving data pipeline robustness and handling real-world data ingestion challenges such as downtime, late-arriving data, and changing schemas.
- Ability to scale data usage in machine learning models by a factor of 10-100x, including incorporating petabyte-scale weather data and increasing the spatial granularity of data for price forecasting.
- Proficiency in designing and implementing scalable data pipelines and infrastructure to support large-scale data processing and machine learning workflows.
- Strong understanding of data reliability and platform scalability, with experience in improving the reliability of data pipelines.
- Experience working with external data sources and managing issues related to data ingestion, such as downtime, late arrivals, and schema changes.
- Educational background or equivalent experience in a relevant field such as Computer Science, Data Engineering, or related disciplines.
- Demonstrated experience in building and maintaining large-scale data systems, preferably in energy, weather, or similar domains involving big data.
- Ability to work collaboratively in a hybrid work environment, with a willingness to work in the Cupertino office 3 days a week.
Benefits & Perks
Hybrid work policy requiring 3 days per week in the Cupertino office
Collaborative, low-ego work environment
Opportunities for continuous learning
Work on impactful, real-world energy and climate problems
Engagement with a high-growth startup with significant expertise in ML, energy, and optimization
Ready to Apply?
Join Gridmatic and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More jobs at Gridmatic
Lead Data Infrastructure Engineer
Gridmatic
Cupertino
Full Time
Dec 24
ML Performance Engineer
Gridmatic
Cupertino
Full Time
Dec 28
ML Performance Engineer
Gridmatic
Cupertino
Full Time
Jan 4