Data engineering lead

Location: We operate a flexible, hybrid working environment with the candidate required to travel to either our Winchester or London office once or twice a week. We offer * Up to GBP80K base salary * 10% Bonus * 6% pension contribution * Private Medical * 25 days annual leave * Access to our comprehensive flexible benefits including discounts on big brands, wellness and employee assistance programmes, gymflex, buy and sell annual leave, travel and dental insurance * Work. Life. Smarter. Our commitment to a flexible and hybrid working culture We are Arqiva, a company that provides critical data, network, and communications services to broadcasters, utilities, and other customers in the UK and around the world. We are looking for a data engineering lead to join our team and deliver upon a major transformation project that will build a modern lakehouse solution using cutting-edge technologies such as Spark, Databricks, AWS, Kinesis, Airflow, Qlik, Great Expectations, GitHub, CodePipeline, Terraform, and Python. As a Data Engineering Lead at Arqiva, you will: bull; Work closely with the data engineering manager, business analysts, data architects, and other stakeholders to understand the business requirements and design the data lakehouse solution. bull; Lead and mentor a team of data engineers and developers in building, testing, deploying, and maintaining scalable, reliable, and secure data pipelines and platforms using best practices of software engineering such as code quality, testing, documentation, version control, continuous integration, and continuous delivery. bull; Implement data ingestion, processing, storage, and delivery systems using Spark, Databricks, AWS, Kinesis, Kafka, Airflow, Glue, Qlik, Great Expectations, GitHub, CodePipeline, Terraform, and Python. bull; Optimize the performance, reliability, and cost-efficiency of the data lakehouse solution. bull; Troubleshoot and resolve any data-related issues and ensure the data quality and integrity using Great Expectations or other tools. To be successful in this role, you will need: bull; At least 5 years of proven experience in data engineering or a similar role. bull; Strong knowledge and experience in working with Spark, GitHub, CI/CD, Python, AWS, and other related technologies. bull; Strong big data development background and experience in building scalable, distributed, and fault-tolerant systems using microservices architecture and API strategy development. bull; Excellent SQL skills and experience in working with various relational and non-relational databases. bull; Good to have experience in working with Databricks, Glue, Kafka, Airflow, Great Expectations, Qlik, Terraform or other related technologies. Why join Arqiva? We are the undisputed leader in UK TV and radio broadcast, and the UK rsquo;s leading Smart utilities platform. This means we have a strong heritage and foundation for future growth for you to grow your career with us. Your wellbeing hellip;. Our wellbeing mission is to help our people to be the best version of themselves at work and still have the time and energy to live a full life outside of work. Our focus for 2024 is to Win, Grow, Go Faster ndash; find out more, contact us and apply! Inclusive Arqiva hellip;.Our networks include our Diversity Ambassadors, Eldercare, Spectrum, Working Families, Pride, Veterans and Inspiring Women ndash; join and contribute to our active networks