Job Description
The Senior Software Engineer, Data at Affinity is responsible for designing and building scalable data pipelines and systems to process large volumes of complex data, collaborating with cross-functional teams to enhance the company's relationship intelligence platform and support strategic data initiatives.
Key Responsibilities
- Design and build scalable, reliable data pipelines for large and complex data sources.
- Collaborate with cross-functional teams to shape product development and data strategy.
- Develop and maintain frameworks for monitoring data quality and integrity.
- Implement and optimize data processing pipelines using event streaming and batch processing technologies.
- Establish and improve CI/CD processes, testing frameworks, and infrastructure-as-code tooling.
- Articulate trade-offs and provide recommendations for data pipeline and storage solutions.
Requirements
- At least 5 years of experience as a Software Engineer or Data Engineer with at least 2-3 years in a Senior Engineering role, leading complex, and sometimes ambiguous, engineering projects across team boundaries.
- Proficiency in designing, building, and maintaining scalable, reliable data pipelines to consume, integrate, and analyze large volumes of complex data from different sources.
- Proven hands-on experience with scalable and robust distributed data systems using Kafka, AWS SQS, or similar technologies.
- Experience working with large datasets and high-scale data ingestion, transformation, and distributed processing tools such as Apache Spark.
- Strong proficiency in SQL.
- Experience with cloud platforms such as AWS, Databricks, GCP, Azure, or related technologies.
- Familiarity with CI/CD processes and test frameworks.
- Ability to partner with product and machine learning teams on large, strategic data projects.
Benefits & Perks
Compensation/salary range: $140,000 to $200,000 USD
Work schedule: Not specified
Work environment perks: Health insurance (medical, dental, vision), flexible personal sick days, retirement plan (401k), annual education budget, wellness reimbursements (home internet, meals, memberships, equipment), virtual team-building activities and socials
Additional benefits: Recognition as a Great Place to Work, awards and certifications, opportunity to work with a leading relationship intelligence platform, inclusive and diverse workplace culture
Ready to Apply?
Join Affinity and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More jobs at Affinity
Manager, GTM Applications
Affinity
Not specified
Full Time
Dec 29
$91k-153k
Account Executive, Growth
Affinity
VISA
Not specified
Full Time
Oct 26
$80k-90k
Senior Director, Engineering
Affinity
Toronto
Full Time
Jan 5
$240k-290k
More jobs in New York, New York
Senior Field Marketing Manager - Public Sector
Celonis
New York
Full Time
Dec 17
$125k-145k
Lead Consultant
Celonis
New York
Full Time
Jan 2
$156k-174k
Senior Field Marketing Manager - Public Sector
Celonis
New York
Full Time
Dec 19
$125k-145k