Which AWS services you have used (Hands-On)? Tell me one use case and one limitation of AWS Lambda function?
Senior Data Engineer Interview Questions
2,562 senior data engineer interview questions shared by candidates
1. Explain the difference between SCD Type1, SCD Type2, SCD Type3
They asked me real-time scenario questions related to my work experience and how I handle production issues.
Given a list of domains, that are entered sorted, we want to minimize the output of urls by uniting sub-domains by only outputting their common ancestor. Also sibling domains should be listed as their common ancestor.
What data validation tool do you have experience with.
Third pat - payroll, Azure services, Databricks, optimizations
Questions based on resume and current project
The HR interview was just a relaxed chat based around values and general compatibility for the role. They ensured that you have done your reading around the company and role. The tech challenge was python based, using a provided API to gather/filter/resubmit data. You had to upload the solution along with appropriate tests to Git. The engineer interview didn’t cover the tech challenge solution at all (surprisingly). It was a general discussion on past experience and projects. Later it switched gears to some more general questions like ‘what is etl?’ or ‘tell us about data streaming products?’ or ‘what problems have you had using semi-structured or unstructured data?’. AWS experience and services used was also covered. The whiteboard session I found the hardest part and was again scenario based where you had to diagnose problems in a process and work with the other engineers to come up with a solution. Later (once the main problem had been covered) more requirements/problems were added to see how you thought on your feed and you were questioned on which products you would use (and why)
OLAP vs OLTP what is data modelling what is where clause
What is BigQuery. What is Partitioning and Bucketing What is Dataflow with example
Viewing 721 - 730 interview questions