Key Responsibilities

- Lead the design and build of high-quality, scalable and reusable data pipelines following Sainsbury’s engineering standards and best practices. - Integrate and manage data from multiple sources, ensuring consistency, integrity and quality throughout the data lifecycle. - Provide guidance for junior & mid Data Engineers on best practices for data infrastructure, including data lakes, warehouses, and distributed processing systems (e.g., PySpark, Hadoop). - Collaborate with data scientists to prepare and transform raw data into formats suitable for machine learning, including feature engineering and data augmentation. - Implement automation tools and frameworks (CI/CD) to streamline the deployment and monitoring of machine learning models in production. - Optimise data processing workflows and storage solutions to improve performance and reduce costs. - Work closely with cross-functional teams, including data science, engineering, and product management, to deliver data solutions that meet business needs. - Mentorship: support junior and mid-level engineers by providing technical guidance on best practices and emergin

Key Responsibilities

- Lead the design and build of high-quality, scalable and reusable data pipelines following Sainsbury’s engineering standards and best practices. - Integrate and manage data from multiple sources, ensuring consistency, integrity and quality throughout the data lifecycle. - Provide guidance for junior & mid Data Engineers on best practices for data infrastructure, including data lakes, warehouses, and distributed processing systems (e.g., PySpark, Hadoop). - Collaborate with data scientists to prepare and transform raw data into formats suitable for machine learning, including feature engineering and data augmentation. - Implement automation tools and frameworks (CI/CD) to streamline the deployment and monitoring of machine learning models in production. - Optimise data processing workflows and storage solutions to improve performance and reduce costs. - Work closely with cross-functional teams, including data science, engineering, and product management, to deliver data solutions that meet business needs. - Mentorship: support junior and mid-level engineers by providing technical guidance on best practices and emergin