Job Description
The Senior Software Engineer, Data at Affinity is responsible for designing and building scalable data pipelines and systems to process large volumes of complex data, collaborating with cross-functional teams to enhance the company's relationship intelligence platform and support strategic data initiatives.
Key Responsibilities
- Design and build scalable, reliable data pipelines for large and complex data sources.
- Collaborate with cross-functional teams to shape product development and data strategy.
- Develop and maintain frameworks for monitoring data quality and integrity.
- Implement and optimize data processing pipelines using event streaming and batch processing technologies.
- Establish and improve CI/CD processes, testing frameworks, and infrastructure-as-code tooling.
- Articulate trade-offs and provide recommendations for data pipeline and storage solutions.
Requirements
- At least 5 years of experience as a Software Engineer or Data Engineer with at least 2-3 years in a Senior Engineering role, leading complex, and sometimes ambiguous, engineering projects across team boundaries.
- Proficiency in designing, building, and maintaining scalable, reliable data pipelines to consume, integrate, and analyze large volumes of complex data from different sources.
- Proven hands-on experience with scalable and robust distributed data systems using Kafka, AWS SQS, or similar technologies.
- Experience working with large datasets and high-scale data ingestion, transformation, and distributed processing tools such as Apache Spark.
- Strong proficiency in SQL.
- Experience with cloud platforms such as AWS, Databricks, GCP, Azure, or related technologies.
- Familiarity with CI/CD processes and test frameworks.
- Ability to partner with product and machine learning teams on large, strategic data projects.
Benefits & Perks
Compensation/salary range: $140,000 to $200,000 USD
Work schedule: Not specified
Work environment perks: Health insurance (medical, dental, vision), flexible personal sick days, retirement plan (401k), annual education budget, wellness reimbursements (home internet, meals, memberships, equipment), virtual team-building activities and socials
Additional benefits: Recognition as a Great Place to Work, awards and certifications, opportunity to work with a leading relationship intelligence platform, inclusive and diverse workplace culture
Ready to Apply?
Join Affinity and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More at Affinity
More jobs at Affinity
iOS Engineer
Affinity
Barcelona
Full Time
Feb 27
Senior iOS Engineer
Affinity
VISA
Barcelona
Full Time
Feb 27
Customer Success Manager, Growth
Affinity
VISA
Remote
Full Time
Feb 20
More jobs in New York, New York
Analyst, Business Intelligence Operations
Coalition for Green Capital
NEW
New York
Full Time
21h
$97k-110k
Senior HRIS Business Analyst Workday HCM - Hybrid New York, NY
Energy Solutions
NEW
New York
Full Time
21h
$107k-134k
Manager of EPA Reporting Compliance
Coalition for Green Capital
NEW
New York
Full Time
2d
$118k-133k