The Databricks Lead / Architect will own end-to-end solution design and provide hands-on technical
leadership across Databricks and cloud data platforms. The role involves translating business and data
requirements into scalable architectures, establishing engineering standards, guiding development
teams, driving modernization and migration initiatives, and working closely with clients, architects and
technology leadership.
Key Responsibilities
• Design and implement enterprise-scale Databricks Lakehouse architectures.
• Define architecture across Azure, AWS and GCP based on business and technical requirements.
• Design data ingestion, transformation and processing using Databricks, Spark, PySpark, SQL and
Python.
• Establish Lakehouse architecture, including Delta Lake, Medallion Architecture and data
modelling.
• Design batch and real-time data processing and integration solutions.
Architect and implement Databricks Workflows, Jobs, Unity Catalog and governance
capabilities.
• Define data security, access control, lineage, quality, monitoring and governance standards.
• Design scalable and optimized solutions for performance and cloud cost.
• Lead migration and modernization of legacy data platforms to Databricks.
• Integrate Databricks with cloud-native services across Azure / AWS / GCP.
• Establish CI/CD, Git, DevOps and deployment standards for data engineering.
• Provide technical leadership through design reviews, code reviews and engineering standards.
• Guide and mentor Data Engineers and technical teams.
• Conduct POCs and evaluate new Databricks/cloud capabilities.
• Work with business stakeholders, project managers and enterprise architects to translate
requirements into technical solutions.
• Support estimation, solution proposals, technical presentations and client discussions.

