Data engineer azure adf databricks

This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. Client Details Global Pharmaceutical Services provider Description This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. You will work on designing and developing their company data acquisition strategy allowing for near real time process reporting and full support of contractual reporting to customers. Key Responsibilities: Monitor and maintain ETL processes to ensure the continuation of an accurate data reporting platform for the business. Explore solutions for optimising the performance of the strategic data platform pipelines, following development design principles Develop and scale the cloud data platforms utilising CI / CD pipelines and Terraform. Help identify and implement the approach to data modelling our business processes in a manner that allows for agile implementation and improvement. Technical implementation of process protocols, quality measures and outcome definitions that allow us to use our data as Real-World evidence. Work with the analytics team to understand and build solutions that combine internal insight, patient outcomes, and external data feeds - creating an opportunity to explore big data and machine learning algorithms. Support the implementation of the security controls that ensure patient data privacy and full compliance with the Data Protection Act / GDPR Help develop and implement the strategic data platform for insights including support to NHS National KPIs and standard operational/financial reporting, Standard Pharma Offerings, Bespoke Customer Solutions, Commercial/Financial Analytics/Planning and Internal Self-Service reporting. Identify key processes where BI can link our business operations with our patients. Help develop and implement the data acquisition strategy ensuring that data is available when needed, accurate and understood. Key Technical Skills required: Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory Databricks Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL) Microsoft SQL server Integrated Services (SSIS) including ETL/ELTL design and development experience. Microsoft DevOps source control software and development lifecycle software Developing and maintaining objects within Data Warehouses / Lakehouses. Experience of working with business data domains / data as a product (Data Mesh). Metadata management / Data qualityProfile Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory Databricks Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL) Microsoft SQL server Integrated Services (SSIS) including ETL/ELTL design and development experience. Microsoft DevOps source control software and development lifecycle software Developing and maintaining objects within Data Warehouses / Lakehouses. Experience of working with business data domains / data as a product (Data Mesh). Metadata management / Data qualityJob Offer Opportunity to work on a major Data Engineering programme Opportunity to work with a global organisation