Senior Data Engineer Interview Questions

2,560 senior data engineer interview questions shared by candidates

1)how do u flatten json nested structure in spark, 2)delete columns based on some conditions in spark, 3)sqoop export with incremental loading 4)datetime related querstions in python 5)problem and need to solve in java 6)lot of scenario based questions related to RDBMS vs Hadoop choice
avatar

Senior Data Engineer

Interviewed at Société Générale

3.7
Dec 23, 2019

1)how do u flatten json nested structure in spark, 2)delete columns based on some conditions in spark, 3)sqoop export with incremental loading 4)datetime related querstions in python 5)problem and need to solve in java 6)lot of scenario based questions related to RDBMS vs Hadoop choice

A: They asked me to walk through a real-world Spark use case I’d implemented—building a streaming ETL for clickstream data—detailing how I managed stateful windowed aggregations, tuned `spark.sql.shuffle.partitions`, and fixed data skew with a custom partitioner.
avatar

Senior Data Engineer

Interviewed at Nubank

4.4
Apr 25, 2025

A: They asked me to walk through a real-world Spark use case I’d implemented—building a streaming ETL for clickstream data—detailing how I managed stateful windowed aggregations, tuned `spark.sql.shuffle.partitions`, and fixed data skew with a custom partitioner.

Viewing 2011 - 2020 interview questions

See Interview Questions for Similar Jobs

Glassdoor has 2,560 interview questions and reports from Senior data engineer interviews. Prepare for your interview. Get hired. Love your job.