Apply Now
Application opens on company website
Job Description
A Data Engineer at Kraken is responsible for managing and analyzing large-scale, complex, and varied data sources to enable insights and support the company's mission to create a sustainable energy system through innovative technology solutions.
Key Responsibilities
- Manage and process high-volume, complex, and unstructured data sources from various microservices
- Develop and maintain data pipelines and infrastructure to support data analysis and modeling
- Enable the business and customers to answer complex questions and derive insights from data
Requirements
- Proven experience in data engineering or related roles with a strong understanding of building and maintaining data pipelines.
- Experience working with high throughput data sources, specifically handling over 10,000,000,000 rows of data per day and managing rapidly growing data volumes.
- Ability to work with complex unstructured and semi-structured data, as well as complex application data from various microservices.
- Strong skills in designing, developing, and maintaining scalable data architectures and pipelines.
- Experience with data modeling, data extraction, transformation, and loading (ETL/ELT) processes.
- Proficiency in programming languages commonly used in data engineering, such as Python, Java, or Scala.
- Experience with cloud-based data storage and processing platforms, such as AWS, GCP, or Azure, is preferred.
- Knowledge of distributed data processing frameworks like Apache Spark, Hadoop, or similar technologies.
- Understanding of data security, privacy, and compliance standards relevant to handling large-scale data.
- Ability to work with both structured and unstructured data sources and integrate external data sources for analysis.
- Strong problem-solving skills and the ability to answer increasingly complex questions based on data insights.
- Excellent communication skills to collaborate with cross-functional teams and explain technical concepts clearly.
- A relevant educational background, such as a degree in Computer Science, Data Science, Engineering, or a related field.
Benefits & Perks
Compensation/salary range not specified
Work schedule not specified
Work environment perks include being a certified Great Place to Work in multiple countries and recognized as a top workplace on Glassdoor
Support for accommodations and personalized interview process upon request
Equal opportunity employer with non-discrimination policies
Ready to Apply?
Join Kraken and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More jobs at Kraken
Head of Financial Systems
Kraken
NEW
London
Full Time
14h
Senior Legal Counsel, Artificial Intelligence & Data
Kraken
NEW
London
Full Time
14h
Senior Client Delivery Lead - Pre-Pay (Energy/Utilities)
Kraken
NEW
London
Full Time
14h
More jobs in Melbourne, Australia
Product Engineer II Field Apps
Esri
Melbourne
Full Time
Dec 31
Electrician (VIC)
Omnidian
VISA
Melbourne
Full Time
Dec 29
Electrician (VIC)
Omnidian
VISA
Melbourne
Full Time
Dec 31