Sr Data Engineer Interview Questions

2,560 sr data engineer interview questions shared by candidates

A developer on the team was running the following line in a function for logging purposes, and the job crashed with an "out of memory" exception. The developer says that the cluster has many workers with a lot of memory and disk and still the job crashes. Can you help explain how come to this line makes the job crash with OOM even though the cluster is huge? def someFunc(): for row in df.collect(): print(f'Customerr{row["customer"]} => Paid {row["price"]}')
avatar

Senior Data Engineer

Interviewed at AppsFlyer

4.1
Mar 16, 2023

A developer on the team was running the following line in a function for logging purposes, and the job crashed with an "out of memory" exception. The developer says that the cluster has many workers with a lot of memory and disk and still the job crashes. Can you help explain how come to this line makes the job crash with OOM even though the cluster is huge? def someFunc(): for row in df.collect(): print(f'Customerr{row["customer"]} => Paid {row["price"]}')

Viewing 1841 - 1850 interview questions

Glassdoor has 2,560 interview questions and reports from Sr data engineer interviews. Prepare for your interview. Get hired. Love your job.