Lead Data Engineer ( Hadoop) - R01549620

Bangalore, India
Job ID: R01549620

Lead Data Engineer ( Hadoop) - R01549620

Lead Data Engineer
Primary Skills
  • MapReduce, HDFS, Spark - Pyspark, ETL Fundamentals, SQL, SQL (Basic + Advanced), Spark - Scala, Python, Data Warehousing, Hive, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures, Oozie
  • Job requirements
  • Primary Skills (Must Have) : Programming language: Python / Java / Scala, Framework: Spark, Hadoop, Declarative language: SQL Secondary Skills (Good to Have) : Databricks , AWS Scope of Work :
  • Developing and maintaining Big Data ETL jobs.
  • Conducting data analysis and profiling.
  • Collaborating with cross-functional teams (e.g., data scientists, business analysts) to align data engineering solutions with business objectives.
  • Automating data workflows to increase system efficiency and reduce manual intervention.
  • Monitoring, troubleshooting, and optimizing data pipelines to ensure high performance and reliability.
  • Ensuring data security and compliance with Mastercard policies and industry standards.

  • Role of Resource : Senior Data Engineer Role USP : Opportunity to work on cutting-edge Big Data technologies like Spark, Databricks, Cloud services with a focus on optimizing and scaling data processing pipelines.
  • If Domain knowledge required : Banking / Mastercard data knowledge is an added advantage and preferable.

  • Experience Range : 5 to 10 years
  • Jobs based on your browsing history

    Together, we create the future you always aspired to. Explore your next career opportunity.

    SEE ALL OPEN POSITIONS