Job Description
The Senior Software Engineer, Data at Affinity is responsible for designing and building scalable data pipelines and systems to process large volumes of complex data, collaborating with cross-functional teams to enhance the company's relationship intelligence platform and support strategic data initiatives.
Key Responsibilities
- Design and build scalable, reliable data pipelines for large-scale data ingestion, integration, and analysis.
- Collaborate with cross-functional teams to shape data and product development roadmaps.
- Develop and maintain frameworks for monitoring data quality, integrity, and security.
- Implement and optimize CI/CD processes, testing frameworks, and infrastructure-as-code tooling.
- Build and deploy data-intensive applications over distributed systems, ensuring performance and scalability.
- Evaluate and recommend approaches for data pipeline and storage solutions aligned with business needs.
Requirements
- 5 years of experience as a Software Engineer or Data Engineer with at least 2-3 years in a Senior Engineering role, leading complex, and sometimes ambiguous, engineering projects across team boundaries.
- Proficiency in event streaming and batch processing pipelines for data-intensive applications.
- Proven hands-on experience with scalable and robust distributed data systems using Kafka, AWS SQS or similar technologies.
- Comfortable working with large datasets and high-scale data ingestion, transformation, and distributed processing tools such as Apache Spark.
- Strong proficiency in SQL.
- Experience with cloud platforms such as AWS, Databricks, GCP, Azure or related technologies.
- Familiar with CI/CD processes and test frameworks.
- Comfortable partnering with product and machine learning teams on large, strategic data projects.
Benefits & Perks
Health Benefits: coverage for medical, dental, and vision insurance premiums with comprehensive PPO, HDHP, and HMO options in CA, and flexible personal sick days
Retirement Planning: 401(k) plan
Learning Development: annual education budget and comprehensive learning and development program
Wellness Support: monthly reimbursements for home internet, meals, wellness memberships, and equipment
Team Connection: virtual team-building activities and socials
Ready to Apply?
Join Affinity and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More jobs at Affinity
Manager, GTM Applications
Affinity
Not specified
Full Time
Dec 29
$91k-153k
Account Executive, Growth
Affinity
VISA
Not specified
Full Time
Oct 26
$80k-90k
Senior Director, Engineering
Affinity
Toronto
Full Time
Jan 5
$240k-290k
More jobs in New York, New York
Senior Field Marketing Manager - Public Sector
Celonis
New York
Full Time
Dec 17
$125k-145k
Lead Consultant
Celonis
New York
Full Time
Jan 2
$156k-174k
Senior Field Marketing Manager - Public Sector
Celonis
New York
Full Time
Dec 19
$125k-145k