Job Description
The role involves managing and optimizing the data platform infrastructure, primarily focusing on Databricks and AWS services, to enable data-driven insights and AI applications across the organization. It includes platform administration, DevOps practices, cross-functional collaboration, and mentorship within a fast-growing, innovative environment.
Key Responsibilities
- Administer, monitor, and troubleshoot Databricks workspaces and AWS infrastructure.
- Develop platform administration tools and capabilities for effective management of platform resources.
- Act as the primary Databricks subject matter expert, guiding teams on platform features and best practices.
- Collaborate with data engineers, analysts, and data scientists to operationalize and optimize data workflows and pipelines.
- Oversee data engineering development ecosystem, including CI/CD pipelines, dev tooling, and monitoring frameworks.
- Implement and manage IaaC automation for Databricks and AWS resources using Terraform, CloudFormation, and CI/CD tools.
- Ensure security, high availability, disaster recovery, and compliance across data services.
- Engage with stakeholders to understand data needs and design scalable data solutions.
- Lead rapid prototyping and proof-of-concept initiatives to evaluate performance, security, and scalability.
- Mentor junior team members and provide technical guidance, training, and knowledge sharing.
Requirements
- Bachelor's or Master's degree in Computer Sciences, Software Engineering, Electrical Engineering, Computer Engineering, or related discipline.
- 10 years experience in a Software Engineering, Platform Engineering, Data Engineering, DevOps DataOps or similar technical role.
- At least 2 years experience in a data infrastructure or platform focused role.
- Experience building, delivering, and administering large-scale production-grade data platforms and services to data engineering, business analyst, and data-science teams.
- Solid knowledge of Databricks features and administration, including Unity Catalog, cluster management, security, troubleshooting, root-cause analysis, and performance optimization.
- Experience and familiarity with AWS services and Cloud Infrastructure provisioning, management, monitoring, and security, e.g., S3, IAM, RDS, Lambda, API-Gateway, VPC, EC2, ECS, EKS.
- Strong knowledge of SQL and Python, and hands-on data-engineering experience in designing and developing data pipelines and ETL routines from sources such as SaaS systems, APIs, RDBMS.
- Skilled with change-data capture, incremental and batch loading techniques.
- Experience troubleshooting underlying issues and translating them into technical solutions.
- Excellent problem-solving, communication, and stakeholder management skills.
- Experience delivering and managing Databricks and AWS Infrastructure for hundreds of users.
- Experience as a technical lead.
- Knowledge of DevOps tools and practices, including GitHub, GitLab, CI/CD systems, Terraform, monitoring and logging tools such as Datadog and CloudWatch.
- Experience implementing robust data governance and security measures to ensure data integrity and compliance.
Benefits & Perks
Competitive total compensation package including base salary, bonus, and RSUs
Employee-led remote and flexible working options
Health benefits
Opportunities for rapid career development and skill mastery
Supportive and collaborative work environment
Inclusive work environment with accommodations for persons with disabilities
Ready to Apply?
Join Samsara and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More jobs at Samsara
Senior Business Value Strategist
Samsara
NEW
Not specified
Full Time
2d
$140k-212k
Chief of Staff, Head of Business Operations, People
Samsara
NEW
SF Bay Area
Full Time
2d
$149k-266k
Senior Manager, Enterprise Collections
Samsara
NEW
Not specified
Full Time
2d
$112k-160k
More jobs in Location not specified
Account Executive APJ
Planet
NEW
Remote
Full Time
2d
Account Executive NATO
Planet
NEW
Remote
Full Time
2d
Account Executive NATO
Planet
NEW
Remote
Full Time
2d