Design pipeline that is relevant to the company
Sr Data Engineer Interview Questions
2,567 sr data engineer interview questions shared by candidates
Context Given a night with X ride requests and Y available drivers in a fictional city, you have to develop a batch processing application that would aggregate and expose data coming from the matching engine. Every Z seconds, the matching engine tries to match every pair of request and driver that are available in the city. Some are matched, some are not. The results of each matching tick are stored in a set of files. Given this data we want to be able to get a overview of the marketplace health and multiple applications could follow such as heat maps. The metrics that we want to use for heat mapping are driver match rate and request match rate. Exercice Develop a microservice that will: Aggregate matching data by fetching new matching data and exploiting this data in order to aggregate driver match rates and request match rates by geo-spatial units of your choice. Expose an endpoint which return the adjusted values of request and driver match rate, following this formula.. Bonus Plot the driver and request match rate for one night
Topics: 1. SQL- Window functions 2. Bigdata Ecosystem 3. Design questions (ETL design)
Tell me the time when you had worked with SQL
Tell me about a time where you had to adapt to an unexpected change
I had 4 rounds of interview.
2 SQL question 1. grouping and having clause. 2. Lag questions (windows function) python - very single (word count in array) and remove duplicates
- Do some basic DB queries with Python. - Study an example AWS cloud architecture, have it explained by a current employee, and talk about how it could be improved. - Normal "Tell me about a time when..." background questions.
How do you deal with customers and the requirements and the deadlines?
It was mostly Technical questions and case interview questions. they emphasize a lot of your analytical and problem solving skills if you are applying for data engineer role
Viewing 1511 - 1520 interview questions