Job Summary
Brief Description
Introduction
- A minimum of 10+ years of experience in data engineering, encompassing the development and scaling of data warehouse and data lake platforms. Should be a Technical leader and capable for working on new proposal if required.
- Working hours: 12 PM to 9 PM IST, with overlap with the EST time zone. The overlap is mandatory, as customer meetings happen during these hours.
Job Description
- A minimum of 10 to 16 years of experience in data engineering, including building and scaling data warehouse and data lake platforms.
- The candidate should have strong hands-on experience with Snowflake and a good understanding of SAP BW/ECC data landscapes, including data extraction, transformation and loading. Should understand SAP ABAP objects, reports, interfaces and extraction logic.
- This is a hands-on Data Engineering Lead role. The person will build and lead data pipelines, guide a team of 6 to 8 data engineers, and take technical ownership of data solution. The role also includes putting together data solution architecture and approach when required, and supporting new proposals.
Responsibilities include:
- Lead hands-on delivery of data pipelines using Fivetran, ETL/ELT processes and data models on Snowflake, with a focus on scalability, performance and reliability.
- Design and document the data solution architecture.
- Extract and transform data from SAP BW/ECC, working with standard SAP objects and BW transformations.
- Mentor and guide the data engineering team of 6 to 8 people, and build skills through knowledge sharing and code reviews.
- Work with stakeholders to understand business needs and turn them into technical specifications and data models.
- Own technical governance for the solutions, including standards, data governance, DataOps practices and quality checks.
- Carry out performance tuning and optimisation of Snowflake databases and queries.
- Track technology announcements in Snowflake, cloud data, governance and DataOps
- Identify ways to extend the data and analytics solution, discussing options with technical teams.
- Support practice activities and new proposals, including reusable accelerators and customer use cases.
Preferred Skills
Primary Skills :
- Strong hands-on experience designing and building data solutions on Snowflake, including schema design, data modelling and performance tuning.
- Experience with Fivetran for transformation and testing.
- Strong SQL and Python (Java or Scala is a plus).
- Strong ETL/ELT and data integration experience, including large data migration.
- Good understanding of SAP BW/ECC data extraction, including standard SAP objects and ABAP logic. This is an understanding requirement, not a development requirement.
- Experience implementing data governance frameworks and DataOps practices.
- Working knowledge of at least one cloud platform (AWS, Azure or GCP).
- Experience putting together data solution designs and approaches.
- Proven track record of delivering complex data solutions on cloud and Snowflake platforms.
Secondary Skills :
- Experience with change data capture (CDC) and real-time or streaming technologies.
- Experience with data visualisation tools such as Power BI or Tableau.
- Knowledge of data security and compliance standards.
- Experience mentoring or leading a small team of 6 to 8 people.
- Clear communication with both technical teams and non-technical stakeholders.
- Strong problem-solving skills and the ability to lead cross-functional work.
Certifications :
- Bachelor’s or master’s degree in computer science, Information Systems, or related field.
- Certifications related Snowflake (e.g., SnowPro core/Snowpro advanced Architect/Snowpro advance Data Engineer) are desirable but not mandatory.