Data Engineer Interview Questions

20,301 data engineer interview questions shared by candidates

Data Modelling: Given an input file for shoppers that should be loaded into row based DB, what is the optimized DB model (table / tables & columns) that will performs best for the following queries: 1) Get shoppers that are eligible for email & FB 2) Get shoppers that are eligible for email OR App 3) Get active shoppers (status = "A") that are NOT eligible for SMS Assumptions: there are 4 different delivery channels: e-mail, App, FB, SMS a shopper may have more than one delivery channels shopper has 2 status: A - Active or D - Disabled input data structure: +----------+-------+-------+--------+--------+--------+---------+ | id (key) | status| city | dc_1 | dc_2 | dc_3 | dc_4 | +----------+-------+--------+--------+--------+-------+---------+ |L1 | A | NY | e-mail | SMS | | | +----------+-------+--------+--------+--------+-------+---------+ |L2 | A | LA | e-mail | FB | App | | +----------+-------+--------+--------+--------+-------+---------+ |L3 | D | LA | SMS | FB | | | +----------+-------+--------+--------+--------+-------+---------+
avatar

Data Engineer

Interviewed at ciValue

4.2
Mar 16, 2023

Data Modelling: Given an input file for shoppers that should be loaded into row based DB, what is the optimized DB model (table / tables & columns) that will performs best for the following queries: 1) Get shoppers that are eligible for email & FB 2) Get shoppers that are eligible for email OR App 3) Get active shoppers (status = "A") that are NOT eligible for SMS Assumptions: there are 4 different delivery channels: e-mail, App, FB, SMS a shopper may have more than one delivery channels shopper has 2 status: A - Active or D - Disabled input data structure: +----------+-------+-------+--------+--------+--------+---------+ | id (key) | status| city | dc_1 | dc_2 | dc_3 | dc_4 | +----------+-------+--------+--------+--------+-------+---------+ |L1 | A | NY | e-mail | SMS | | | +----------+-------+--------+--------+--------+-------+---------+ |L2 | A | LA | e-mail | FB | App | | +----------+-------+--------+--------+--------+-------+---------+ |L3 | D | LA | SMS | FB | | | +----------+-------+--------+--------+--------+-------+---------+

1. Walk through the your coding process? 2. What are the challenges faced by you and how you overcame them? 3. Interview stressed a little about the datastructures? 4. Knowledge about data pipeline is a plus.
avatar

Insight Data Engineer Fellow Ship

Interviewed at Insight Data Science

4
Apr 28, 2016

1. Walk through the your coding process? 2. What are the challenges faced by you and how you overcame them? 3. Interview stressed a little about the datastructures? 4. Knowledge about data pipeline is a plus.

Given live minutely data for various tickers, how would you design a system that executes a DAG of computing thousands of signals, making everything available in a relational database? How would you publish the availability of this data (not the data itself, but metadata about it)? How would you publish and facilitate tracking if one or more signals could not be computed?

Lead Data Engineer

Interviewed at Rengen Labs

3.9
Jun 15, 2022

Given live minutely data for various tickers, how would you design a system that executes a DAG of computing thousands of signals, making everything available in a relational database? How would you publish the availability of this data (not the data itself, but metadata about it)? How would you publish and facilitate tracking if one or more signals could not be computed?

Viewing 2351 - 2360 interview questions

Glassdoor has 20,301 interview questions and reports from Data engineer interviews. Prepare for your interview. Get hired. Love your job.