Data Engineer

YouGov is an international market research and data analytics group.

Our mission is to supply a continuous stream of accurate data and insight into what the world thinks, so that companies, governments and institutions can better serve the people and communities that sustain them. 

We have the best data and the best tools. We continuously challenge conventional approaches to research, and we disrupt our industry to ensure that our clients always get the best solutions.

We are driven by a set of shared values. We are fast, fearless and innovative. We work diligently to get it right. We are guided by accuracy, ethics and proven methodologies. We respect and trust each other, and bring these values into everything that we do.

Each day, our highly engaged proprietary global panel of over 15 million people provides us with thousands of data points on consumer opinions, attitudes and behaviours. We combine this continuous stream of data with our research expertise to provide insights that enable intelligent decision-making and informed conversations.

With operations in the UK, North America, Mainland Europe, the Nordics, the Middle East, India and Asia Pacific, YouGov has one of the world’s largest research networks.

The Culture

Diversity and inclusion are fundamental to YouGov. We are committed to giving the world a voice by capturing the opinions of all groups, including the ones that are often under-represented in research. We are also committed to making sure that our products and tools are free from any bias, as accuracy is key to what we do. None of the above can be done without having a truly diverse workforce, in an inclusive workplace. We are very keen on attracting and retaining the best talent. And best talent also means a diverse pool of talent, with various backgrounds and perspectives.

Supporting the wellbeing of our staff, including maintaining a good work and life balance, is important to us. We support flexible working arrangements where appropriate for a role, with many locations offering a hybrid office-and-remote working approach.

As an Equal Opportunity Employer, qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, veteran status, disability status, or any other characteristic protected by law. All employment decisions are made on the basis of occupational qualifications, merit, and business need.

Working inside the Data Intelligence Unit, you will help turn raw data into insight by building automated ETL applications, streaming data processors, RESTful microservices and browser-based user interfaces. In particular you will develop the automated “Audience Data” delivery system that enables clients to define target audiences in a variety of partner platfoms using YouGov’s wealth of data.

Day to day you will:

• Build new features for our automated data infrastructure using Python

• Optimise applications to increase performance and reliability

• Support ongoing data pipelines, ensuring every deliverable reaches its intended destination

• Collaborate with internal stakeholders to design appropriate, automated solutions for new data delivery and integration needs

A successful candidate must:

• Love writing beautiful, idiomatic code, particularly Python

• Be comfortable in the modern realm of test-driven, version-controlled software development

• Have experience in building substantial ETL pipelines

• Enjoy solving complex technical problems

• Be eager to develop new skills and expertise

• Be proactive, positive and professional

Experience with any of the following technologies is desirable:

• Luigi, Flask, SQLAlchemy, Pandas

• Docker, Kubernetes

• JavaScript, HTML, CSS

• PostgreSQL, Redis, RabbitMQ

• Amazon S3, EC2, Redshift

• Hadoop, Hive, Spark

• A degree in a quantitative discipline (e.g. Computer Science, Statistics, Maths or similar) or equivalent experience 

• 3+ years continuous experience working as a data engineer or software developer

• Experience wrangling large datasets efficiently  

• Experience with relational databases (SQL) 

• Ability to translate business needs into software features and deliver results in a timely manner

• Good communication in English: both written and verbally 

This role can be based in the UK or any EU country in which we have an entity (Spain, Italy, Poland, Germany to name a few) and is 100% remote.