Lead Data DevOps Engineer

Job description

We are seeking a Lead Data DevOps Engineer to join a team that implements and supports essential components of an Azure data platform. This includes infrastructure changes, monitoring, end-to-end tracking, automation and self-healing, anomaly detection, event correlation and analysis, performance analysis, and access permissions management.

Responsibilities

- Build and maintain advanced Terraform configurations and Azure DevOps pipelines spanning multiple subscriptions and environments

- Engage with various stakeholders to ensure technical solutions meet business requirements

- Enhance performance while monitoring, troubleshooting, and preventing issues across data workloads

- Work alongside Architecture teams to confirm that platform architecture and design standards align with the support model

- Pinpoint ways to optimize data platform activities, support processes, and operational workflows

- Streamline and automate administrative tasks, infrastructure, and application deployments

- Team up with the SRE group to maintain platform reliability and stability

Requirements

- 5+ years working with Azure Cloud services, Azure DevOps, Azure PowerShell, and Terraform

- 1+ years of relevant leadership experience

- Hands-on expertise in infrastructure automation using Terraform and Azure DevOps pipelines across multiple subscriptions and environments

- Strong communication skills for engaging with technical and business stakeholders alike

- Solid grasp of platform architecture and design standards to enable effective collaboration with Architecture teams

- Ability to spot and execute automation opportunities across administrative, infrastructure, and deployment tasks

- English proficiency at a B2+ level

Nice to have

- Familiarity with Azure Data Factory, Azure Data Lake Storage, and Azure Databricks

- Working knowledge of Azure Monitor and Azure SQL Database

- Experience with Azure Storage and Azure Synapse Analytics