• Sign In
  • |
  • Register
About The Role
Thanks for your interest in joining BPDTS Ltd.

Our digital, data and technology specialists work closely with experts across DWP Digital’s community to transform services used by millions of people each and every day. 

Operating on a scale unrivalled almost anywhere, our people use their expertise, diversity and passion to create effortless, secure and intuitive digital services.  In return, we offer our people the chance to think big, try new ways of working and use their expertise to deliver change on a massive scale.

If you want to join our team please click continue and complete and application now. If you have not yet registered you will be asked to complete a short registration process first.

Please refer to our job specification for more information about BPDTS Ltd, the role, the application process and more.

Essential Skills

  • Hands-on experience on Data Engineering projects delivering data processing pipelines in a cloud or on premise environment (distributed ETL and machine learning) using Hadoop to support different analytics use cases, relating to high-volume, complex and distributed datasets; creating and maintaining data pipelines, data streaming, working with large sets of unstructured and structured data and creating curated datasets for end users.
  • A good understanding of big data engineering techniques and concepts using Hadoop; data streaming, data transformation, data loading strategy, data archiving, data reconciliation, data manipulation, data integration, error handling, error logging mechanism, standards and best practices with hands-on experience in developing data solutions.
  • Good working knowledge of:
    • Spark SQL
    • Hive SQL
    • Spark Streaming
    • Python
    • Scala
    • HDFS
    • OOzie
    • GitHub
    • Unix
  • Experience of developing data solutions on Oracle, Clodera or HortonWorks platforms. 
  • An ability to quickly comprehend and convert business requirements into technical solutions. 
  • Significant and demonstrable experience implementing Data Engineering best practices.

About The Company

We’re incredibly proud of what we’re achieving; providing digital technology services to the Department for Work and Pensions.

Our digital, data and technology specialists work closely with experts across DWP Digital’s community to transform services used by millions of people each and every day.

As public servants, our services help make a difference to people at critical times in their lives – as they look for work, deal with illness or disability, support children after separation, or plan for retirement. Operating on a scale unrivalled almost anywhere, our people use their expertise, diversity and passion to create effortless, secure and intuitive digital services.

In return, we offer our people the chance to think big, try new ways of working and use their expertise to deliver change on a massive scale. We already employ hundreds of digital, data and technology specialists.

Our experts include: technical architects, infrastructure engineers, software and testing engineers, agile delivery managers, business analysts, database analysts and IT service managers to name but a few.