Summary
I interviewed for a Data Engineer 2 role at Lloyds Banking Group in Hyderabad and was selected after three rounds covering project discussions, technical questions on SQL, Spark, and system design, followed by an HR round.
Full Experience
Interview Experience: No OA Because one of my friend referred and i had strong profile which matched completely with JD.
Round 1 Deep discussion on projects
- why choose this tech stack
- Alerting + Monitoring
- Deployment strategies used
- CI/CD
- Can you write Airflow code
SQL Questions on window functions
Round 2 Asked technical Questions
- spark vs hadoop
- spark transform, jobs, stages
- spark sql (window functions)
- Sql join questions
- Real life scenarios where joins are used
- many more on sql and spark
Round 3 HR
Verdict Selected
Interview Questions (8)
Discussion on the rationale behind choosing specific technologies for projects.
Discussion on strategies and implementation of alerting and monitoring for data pipelines/systems.
Discussion on deployment strategies used for data engineering projects.
Discussion on Continuous Integration/Continuous Deployment practices relevant to data engineering.
Question testing the ability to write Apache Airflow code.
Comparison between Apache Spark and Apache Hadoop, discussing their use cases, architectures, and advantages/disadvantages.
Discussion on Spark transformations, jobs, and stages, covering their concepts and how they relate to Spark's execution model.
Discussion on practical, real-world scenarios where different types of SQL joins (INNER, LEFT, RIGHT, FULL OUTER) would be applied.