Data engineer

The Role: The Best Connection Group Limited is looking to appoint an experienced Data Engineer responsible for developing, maintaining, and optimising our data warehouse, data pipeline and data products. The Data Engineer works with a variety of stakeholders to analyse their needs and ensure an optimal data delivery architecture. Key Responsibilities: Work with data to solve business problems, building and maintaining the infrastructure to answer questions and improve processes. Help streamline our data workflows, adding value to our service offerings. Work closely with the BI teams to develop data models and pipelines for research, reporting and insight analysis. Be an advocate for best practices and continued learning. Design, build and maintain batch or real-time data pipelines in production. Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a variety of data sources. Develop ETL (extract, transform, load) processes to help extract and manipulate data from multiple sources. Automate data workflows such as data ingestion, aggregation, and ETL processing. Prepare raw data in Data Warehouses into a consumable dataset for both technical and non-technical stakeholders. Monitor data systems performance and implement optimization strategies. Leverage data controls to maintain data privacy, security, compliance, and quality for allocated areas of ownership. The Package: Annual salary of GBP43,000 to GBP48,000 depending on experience and qualifications Initially you will be entitled to 30 days paid holiday per annum, rising to 33 days after a year rsquo;s employment inclusive of statutory holidays. Free Car Parking Pension Cycle to work scheme. Option to join opt into our employee benefits scheme.The Person: Essential Criteria: Bachelor rsquo;s degree in computer science, Math, Software Engineering, Data Engineering, or a related field Minimum 2 years rsquo; experience in analytics, data science, data modelling or data engineering Advanced SQL skills and experience with relational databases and database design. Experience as a Data Engineer manipulating and transforming data in Spark SQL, PySpark, or Spark Scala Experience working with cloud Data Warehouse solutions. Excellent problem-solving, communication, and organisational skills. Proven ability to work independently and with a team.Desirable Criteria Experience with implementing Microsoft Fabrics based solutions. Experience translating business requirements into technical requirements. The Company The Best Connection, an Equal Opportunities Employer, was formed in 1991. The company has a network of over 85 branches throughout the UK from which it specialises in the supply of temporary labour to the industrial, HGV, warehouse, and distribution sectors. With a turnover of GBP347 million, The Best Connection is one of the largest providers of Industrial and Driving staff in the UK. Hours of Work: Your working week will consist of 37.5 hours Monday - Friday with 1 hour rsquo;s lunch break each day. The role will be office based at out Head Office in Bromsgrove with some opportunities for flexible working