Job Description
The Senior Data Engineer at Affinity is responsible for designing and building scalable data pipelines, managing data quality and security, and collaborating with cross-functional teams to support the company's relationship intelligence platform and data-driven product development.
Key Responsibilities
- Design and build scalable, reliable data pipelines for large and complex data sources.
- Collaborate with cross-functional teams to utilize data for product development and insights.
- Monitor, maintain, and improve data quality, integrity, security, and compliance.
- Develop and optimize ETL/ELT solutions using tools like Spark, Python, Databricks, Kafka, and AWS services.
- Define data roadmap and establish best practices for data extraction, transformation, and storage.
Requirements
- Minimum of 5 years of experience as a Data Engineer or Data Platform Engineer, working on complex, sometimes ambiguous engineering projects across team boundaries.
- Proficiency in data modeling, data warehousing, and ETL pipeline development.
- Hands-on experience building scalable data platforms and reliable data pipelines using Spark and Databricks.
- Familiarity with Hadoop, AWS SQS, AWS Kinesis, Kafka, or similar technologies.
- Experience working with large datasets and high-scale data ingestion, transformation, and distributed processing tools such as Apache Spark Scala or Python.
- Strong proficiency in SQL.
- Familiarity with industry-standard databases and analytics technologies, including Data Warehousing and Data Lakes.
- Experience with cloud platforms such as AWS, Databricks, GCP, Azure, or related technologies.
- Familiar with CI/CD processes and test frameworks.
- Ability to partner with product and machine learning teams on large, strategic data projects.
Benefits & Perks
Compensation/salary range: 113,000 to 187,000 CAD
Work schedule: Flexible personal sick days
Work environment perks: Virtual team-building activities and socials
Health Benefits: Extended health benefit premiums for employee and dependents, wellness memberships, home internet, and meals reimbursement
Retirement Planning: RRSP plan
Learning Development: Annual education budget and comprehensive learning and development program
Ready to Apply?
Join Affinity and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More at Affinity
More jobs at Affinity
Manager, GTM Applications
Affinity
Not specified
Full Time
Dec 29
$91k-153k
Account Executive, Growth
Affinity
VISA
Not specified
Full Time
Oct 26
$80k-90k
Senior Director, Engineering
Affinity
Toronto
Full Time
Jan 5
$240k-290k
More jobs in Toronto, Ontario
Consulting Associate Cybersecurity Incident Response Forensic Services practice
Charles River Associates
Toronto
Full Time
Dec 20
Associate Litigation Life Sciences practice
Charles River Associates
VISA
Toronto
Full Time
Oct 23
Senior Manager, Recruiting
Samsara
Toronto
Full Time
Dec 17
$123k-169k