Data Engineer at Common Code (Melbourne, Australia)

Help us make a big green dent in the universe. We're on a mission to drive the global renewable energy revolution, and we need loads more people to help us make our vision a reality.

At Octopus we’ve developed a data platform that provides data services to the business in the UK and our retail energy businesses around the world. The platform enables self-service of data analytics to hundreds of data hungry users as well as automation of all our data workflows from simple ETL jobs to ML training and prediction.

The data platform team works across the whole customer domain on anything from natural language understanding of our customer communications to processing billions of smart meter readings to build customised smart energy tariffs.

As the volume, scope and geographical range of our data services rapidly expand, we’re looking for an experienced data engineer to join the team to help us build and maintain our platform, pipelines and data sources.

This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero with a company that is passionate about building great technology to change the way customers use energy.

What you'll do

• Build new data sources and data pipelines that deliver key data and insights to the business


• Work closely with the data science and analytics teams to maintain and develop our central data models in dbt


• Build and maintain testing and documentation frameworks for our data sources


• Work with the business to scope and deliver new data engineering projects and requirements


• Maintain and build on our existing data infrastructure and tools


• Support the internationalisation of our data infrastructure as we continue to grow globally

Our Data Stack

• Python as our main programming language


• Kubernetes for data services and task orchestration


• Airflow purely for job scheduling and tracking


• Circle CI for continuous deployment


• Parquet and Delta file formats on S3 for data lake storage


• Spark for data processing


• dbt for data modelling


• Presto and SparkSQL for analytics


• Streamlet for data applications

What you'll have

• First and foremost, we want our data engineers to be great software engineers with a passion for writing high quality code


• It would be helpful to have experience/expertise in Spark and SQL


• Experience modelling data for analytics - ideally experience using dbt as a modelling tool


• Experience in assuring data quality


• Experience deploying data services in a cloud environment (ideally AWS)


• The projects will be varied and we’re looking for someone who can work autonomously and proactively to scope problems and solve and deliver pragmatic solutions

What you'll love about us

• Our company culture - we won best company to work for in 2019 and our CEO, Greg has recorded a podcast about our culture and how we empower our people


• Flexible working environment - genuine work life balance here, we are in the top 5 companies in the UK, we treat you as a human, and do our best to make work and life merge smoothly together


• Holiday - 23 days plus bank holidays


• Equity Options Scheme - you own your own part of the business, share options in the whole Octopus Energy Group so we all work together towards success


• Office culture - have a certain tech requirement? We’ll do our best to get it. Our offices are also stocked with fruit, breakfast, great coffee and soft drinks. Weekly on a Friday we all get together (this happens virtually too) for company updates and drinks - we call it Family Dinner


• Social Events - we sponsor YeoValley’s summer festival, valleyfest, every year for our big offsite Summer party (we take our kids too) and we also aim to have 3 parties a year


• Your development is important - we support and help with development including internal and external courses, learning, study support etc, all bespoke to you


• Cycle to Work Scheme - to help lower your carbon footprint whilst good for your health