Azure data engineer

Two driven and knowledgeable Azure Data Engineers to support a variety of data-related projects over the next two years are needed to join our team at Central Bedfordshire Council. You will have an opportunity to work with cutting-edge Azure ecosystem tools, including Databricks and Synapse Analytics. This is a challenging and rewarding role within a supportive team environment. Join us and make a significant impact on Central Bedfordshire Council #39;s data infrastructure and services. These positions are critical in facilitating our data migration projects as well as contributing to the development of the CBC Azure Data Platform/Lakehouse projects. About Us Central Bedfordshire is an ambitious authority, determined to be an exemplary one. Our strategic location and high quality of life mean we are one of the fastest-growing areas in the country. As a council, we face the same challenges every business does - investing in the right places and delivering great results. Except for us, it rsquo;s all about our 289,000 residents. We rsquo;re totally focused on helping to improve their lives and making Central Bedfordshire a great place to live and work. We have set values and principles to represent the way we work and how we operate as an organisation. This is a great time to join us on our journey. Key Responsibilities: * Lead migrations from on-premises SQL Server to CBC Microsoft Azure SQL and/or 3rd Party hosted platforms. * Execute Data Migration ETL Projects to migrate data to new target replacement systems. * Contribute to the CBC Azure Data Platform/ Lakehouse projects, by designing and implementing data warehouses and dimensional models. * Develop ETL data pipelines using Azure Data ETL tools such as Data Factory and Databricks. An understanding of legacy SSIS packages will be beneficial. * Write Python/ PySpark scripts and T-SQL for Lakehouse/ Database management (tables, views, indexes, stored procedures). * Use Azure Data Factory, Databricks, and Synapse for advanced data engineering tasks. * Work with related Azure resources including Key Vault, Storage Accounts and understanding of Azure DevOps. * Support reporting and analytics using tools like PowerBI or equivalent. Skills and Experience: * Experience as a Data Engineer/Specialist in data warehouse and migration projects * Ability to hit the ground running with minimal supervision and proficiency in Azure Synapse Serverless SQL and associated technologies * Essential experience in Python/ PySpark and T-SQL scripting, Azure Data Factory, Databricks, and Synapse Analytics, designing and implementing Data warehouses and associated dimensional models * Proficient in reporting and analytics tools, such as PowerBI * A strong background in developing ETL data pipelines with Azure Data ETL tools is also required This role is covered by the Code of practice of the English language requirements for public sector workers Benefits: * Annual leave allowance of 25 days+ statutory holidays rising to 32 days with length of service * Generous family-friendly policies and practices * Local Government Pension Scheme (LGPS) - This is a valuable part of our rewards package for employees and includes life insurance * Staff electric vehicle (EV) leasing scheme at competitive rates (permanent staff only) * A comprehensive IT package * Annually paid social work fees for qualified social workers in adults and children rsquo;s (including senior practitioners) and Team Managers where required * Access to discounts on top UK retailers and local retailers * A hybrid working arrangement * A GBP250 one-off hybrid worker payment to help you adapt your home for safe and suitable working conditions * The ability to work abroad for up to a month a year Sounds interesting? Click the APPLY button to send your CV for immediate consideration. Candidates with previous experience or job titles including; Azure Data Engineer, Cloud Data Engineering Specialist, Azure Data Platform Engineer, Cloud Data Architect, Azure Data Solutions Engineer, Azure Data Integration Engineer, Cloud Data Pipeline Engineer, Azure Data Warehouse Engineer, Cloud Data Infrastructure Specialist, Azure Data Analytics Engineer will also be considered