Lead with MS SQL Server and Snowflake

Job description

We are looking for an experienced Lead Data Integration Engineer to represent EPAM with our client and oversee the transition of a ~17-person stream from another vendor.

This role combines leadership responsibilities with hands-on work, requiring proficiency in MS SQL, Snowflake, and related technologies to ensure efficient data integration and transformation processes.

Responsibilities

- Lead a new team of ~5-7 EPAM Database Engineers and QAs during the vendor transition process

- Dedicate 50-70% of the time working directly with code and tools

- Design ETL jobs using MSSQL, Snowflake SQL, and Talend to migrate and transform data to Data Lakes

- Develop automated workflows for data cleaning, transformation, and relocation to predefined destinations

- Identify process enhancements to improve automation, scalability, and data delivery efficiency

- Collaborate with data and analytics teams to optimize systems for functionality and user experience

- Streamline data access processes for team consumption and analytics display purposes

- Handle database performance issues on occasion, ensuring smooth operations

Requirements

- 5+ years of experience with MS SQL Server, including extensive knowledge of database development and optimization

- 1+ years of Snowflake experience, including designing and implementing data integration workflows

- 1+ years of leadership experience in related positions

- Proficiency in ETL tools and frameworks such as Talend

- Familiarity with cloud environments like AWS and storage solutions such as S3

- Strong English communication skills, at least at a B2+ level

Nice to have

- Background in Data Warehouse Management with strong knowledge of the data lifecycle

- Proficiency in visualization tools like Microsoft Power BI

- Competency in conducting audits within cloud warehouses

- Understanding of Data Governance Tools such as Oval Edge or similar for metadata profiling and cataloging

- Capability to utilize Change Data Capture Tools for real-time synchronization configuration and management