Job Description
The Senior Data Engineer at Affinity is responsible for designing and building scalable data pipelines, managing data quality and security, and collaborating with cross-functional teams to extract insights from large datasets, supporting the company's relationship intelligence platform.
Key Responsibilities
- Design and build scalable, reliable data pipelines for large and complex data sources.
- Collaborate with cross-functional teams to utilize data for product development and insights.
- Monitor, maintain, and improve data quality, integrity, and security.
- Develop and optimize ETL/ELT solutions using tools like Spark, Databricks, Kafka, and AWS services.
- Define and implement data architecture, storage solutions, and data roadmap strategies.
Requirements
- Minimum of 5 years of experience as a Data Engineer or Data Platform Engineer, working on complex, sometimes ambiguous engineering projects across team boundaries.
- Proficiency in data modeling, data warehousing, and ETL pipeline development.
- Hands-on experience building scalable data platforms and reliable data pipelines using Spark and Databricks.
- Familiarity with Hadoop, AWS SQS, AWS Kinesis, Kafka, or similar technologies.
- Experience working with large datasets and high-scale data ingestion, transformation, and distributed processing tools such as Apache Spark Scala or Python.
- Strong proficiency in SQL.
- Familiarity with industry-standard databases and analytics technologies, including Data Warehousing and Data Lakes.
- Experience with cloud platforms such as AWS, Databricks, GCP, Azure, or related technologies.
- Familiar with CI/CD processes and test frameworks.
- Ability to partner with product and machine learning teams on large, strategic data projects.
Benefits & Perks
Compensation/salary range: $106,200 to $200,000 USD
Work schedule: Not specified
Work environment perks: Health insurance (medical, dental, vision), flexible personal sick days, 401(k) retirement plan, annual education budget, wellness reimbursements (home internet, meals, memberships, equipment), virtual team-building activities and socials
Additional benefits: Inclusive and diverse workplace culture, opportunities for learning and development, recognition as a Great Place to Work, E-Verify employment verification
Ready to Apply?
Join Affinity and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More jobs at Affinity
Manager, GTM Applications
Affinity
Not specified
Full Time
Dec 29
$91k-153k
Account Executive, Growth
Affinity
VISA
Not specified
Full Time
Oct 26
$80k-90k
Senior Director, Engineering
Affinity
Toronto
Full Time
Jan 5
$240k-290k
More jobs in New York, New York
Senior Field Marketing Manager - Public Sector
Celonis
New York
Full Time
Dec 17
$125k-145k
Lead Consultant
Celonis
New York
Full Time
Jan 2
$156k-174k
Senior Field Marketing Manager - Public Sector
Celonis
New York
Full Time
Dec 19
$125k-145k