Senior Data Platform Engineer
Octopus EnergyLondon (GB), United Kingdom
Full Time
Posted July 23, 2026
£27k - £29k· Est.
~30 people viewed this recently
Apply Now
Application opens on company website
Job Description
Help us make a big green dent in the universe.
Key Responsibilities
- Build and maintain Infrastructure-as-Code (IaC) using Terraform across development, test, and production environments .
- Strengthen CI/CD practices in GitHub Actions, establishing repeatable deployment patterns, environment promotions, automated rollbacks, and release controls .
- Support architecture decisions by converting designs into maintainable, well-documented engineering patterns .
- Design and implement federated identity architecture across Okta, Entra ID, and ZScaler .
- Build identity, token exchange, and permission propagation models that work for both human users and non-human AI agents .
- Implement SCIM provisioning/deprovisioning and access models with single-revoke capability and full auditability .
- Harden existing AI gateway and agent orchestration layers (built on MCP patterns) into secure, production-ready capabilities .
- Implement API gateway controls: authentication, routing, rate limiting, token budgets, policy-as-code, and action logging .
- Build platform-, tool-, and agent-level kill switches, alongside dry-run/safe-testing modes for agent workflows .
- Implement AI system observability, including prompt logging, output monitoring, quality scoring, and drift detection .
- Establish operational monitoring for gateway usage, latency, error rates, and model routing logic .
- Enforce token budgets, cost alerts, and usage/cost attribution by team and use case .
- Deploy vector database and retrieval infrastructure (e.g., Databricks AI Search) to support Document AI and RAG use cases .
- Align platform controls with Databricks and Unity Catalog governance patterns .
- Provide clear documentation, reusable patterns, and self-service onboarding guidance so delivery squads can deploy tools without bespoke manual intervention .
Requirements
- Federated Identity Mastery: Proven experience designing and implementing enterprise-grade federated identity, token exchange, permission propagation, SCIM provisioning, and access lifecycle management .
- Platform Foundations: Strong hands-on experience with IaC (Terraform) and production CI/CD pipelines (environment promotion, rollback, release controls) .
- API Gateways: Experience hardening API gateway patterns (authentication, routing, rate limiting, access policy enforcement) .
- Cloud & Data Environments: Technical comfort working across Azure, AWS, or Databricks platform ecosystems .
- Pragmatic Mindset: Highly autonomous engineer comfortable in a lean team; skilled at translating architectural specs into practical code and communicating trade-offs clearly in plain English
Ready to Apply?
Join Octopus Energy and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More at Octopus Energy
More jobs at Octopus Energy
Is this your company?Claim your listing — free →