I am a professional data engineer with demonstrated experience in building optimal ETL pipelines and providing solutions to complex data analytics problems using PySpark. I also have a very good experience in solving production issues with quick turnaround, optimize/tune performance of the jobs significantly and guide people on choosing best strategy for their ETL batch job development in PySpark. I have very good experience in designing end to end project in Big data using hadoop,hive,python and pyspark.