We are seeking a skilled Lead Data Engineer to work on a large scale Data and Analytics Platform which will enable health and care organisations store, access and analyse data effectively and secure.
Day to day activities
*Lead the design and implementation of scalable, reliable data pipelines and data platforms in the Google Cloud Platform.
*Collaborate with data scientists, analysts, and other engineering teams to define data requirements and optimize data workflows.
*Oversee the deployment and integration of data systems on the Google Cloud Platform.
*Ensure the security, compliance, and performance of Google Cloud Platform data solutions.
*Drive best practices in cloud-based data engineering, automation, and DevOps for data solutions.
*Mentor and guide Senior Data Engineers, contributing to team skill growth and knowledge sharing.
Essential Experience
*Experience in cloud platform as a service (PaaS).
*Ability to communicate between technical and non-technical stakeholders, managing expectations and supporting difficult discussions.
*Ability to support teams to apply a range of techniques for data profiling, undertake source system analysis and bring multiple data sources together.
*Can establish enterprise-scale data integration procedures across the data development life cycle.
*Ability to manage resources to ensure that data services work effectively.
*Can identify areas of innovation in data tools and techniques.
*Ability to establish and maintain standards, remaining informed of industry best practice.
*Can understand concepts and principles of data modelling and produce relevant data models.
*Ability to recognise opportunities for the reuse and alignment of data models.
*Ability to solve problems with the most appropriate actions providing co-ordination of teams to implement solutions.
*Can use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts, collaborating with others as appropriate.
*Have a clear understanding of the technical concepts required for the role and how these fit in the wider technical landscape.
*Ability to review requirements, define test conditions, identify issues and risks and analyse and report test activities.
*Experience with Google Cloud Platform for data and analytics.
*Ability to design an appropriate metadata repository, improve existing repositories, understand a range of tools to manage metadata and advise team members on metadata management.
*Rates depend on experience and client requirements