A Senior Software Engineer responsible for scaling and improving the reliability of Gridmatic's data infrastructure to support large-scale machine learning models for energy price forecasting and grid optimization.
Key Responsibilities
Scale and improve the reliability of data infrastructure for large-scale ML models
Ingest and manage petabyte-scale weather, price, load, and grid data
Enhance data pipelines to handle external data source issues such as downtime, late arrivals, and schema changes
Requirements
Experience in scaling and improving the reliability of data infrastructure, including handling large-scale data ingestion, processing, and storage systems.
Ability to scale data usage in machine learning models by a factor of 10-100x, incorporating petabyte-scale weather data and increasing spatial granularity of price forecasting.
Proficiency in addressing real-world data pipeline challenges such as downtime, late-arriving data, and changing schemas, and improving the reliability of data pipelines.
Strong understanding of data platform architecture and engineering principles relevant to high-growth startup environments.
Experience with data ingestion from external sources and managing data quality issues.
Ability to work collaboratively in a hybrid work environment, with a willingness to work in the Cupertino office 3 days a week.
Benefits & Perks
Hybrid work policy requiring 3 days per week in the Cupertino office
Opportunity to work on complex real-world problems involving large-scale data challenges
Collaborative, low-ego work environment with an emphasis on rigorous thinking, autonomy, and continuous learning
Ready to Apply?
Join Gridmatic and make an impact in renewable energy