You Can Be Anything › All careers › Mathematics & Data

Data Engineer

Builds and maintains the infrastructure that allows organizations to collect, store, and analyze massive datasets.

Did you know?

Back in 2014, Facebook said it was generating 4 new petabytes (4 million gigabytes) of data every day. Data engineers build the pipes that carry it.

How subjects help

Computer Science: Build pipelines that move data from apps into databases without losing any.
Mathematics: Design storage and searches that stay fast even as the data grows enormous.
Statistics: Check incoming data for errors and odd values before analysts use it.
Engineering: Design reliable systems that keep running even when one server breaks down.

A famous name

Edgar F. Codd: Invented the relational database model in 1970, the basis of how most data is stored today.

Try it yourself: Catch a flipped coin like a network does

Lay 16 coins in a 4 by 4 square, heads or tails at random.
Add a fifth coin to the end of each row and the bottom of each column so every row and column has an even number of heads. Add one in the corner too. This is your "parity" check.
Turn away while your helper flips just one coin.
Turn back and find the row and the column that now have an odd number of heads. The flipped coin is where they cross.
Swap and let your helper try, then try a bigger grid.

Network and telecoms engineers rely on extra check bits like these, so that when data is damaged on its way across a network the error can be spotted and often fixed.

Adapted from CS Unplugged (University of Canterbury): Parity magic.

Also try: Which dice total wins?.

Known for it in

USA, Germany, UK, Netherlands, India