Talent.com
This job offer is not available in your country.
Senior Data Engineer - Spark / Hadoop

Senior Data Engineer - Spark / Hadoop

TechmoraBangalore
14 days ago
Job description

Job Title : Senior Data Engineer

Location : Bangalore / Gurgaon

Employment Type : Full-time

Experience : 4 - 9 years

Notice Period : 30 days

About the Role :

We are looking for a Senior Data Engineer to design, build, and maintain robust data pipelines and scalable data infrastructure. You will work closely with data scientists, analysts, and other engineering teams to ensure the availability, quality, and reliability of data across the organization.

Key Responsibilities :

  • Design, develop, and maintain scalable ETL / ELT pipelines for structured and unstructured data.
  • Build and optimize big data solutions using frameworks such as Hadoop and Spark.
  • Implement and manage cloud-based data platforms (AWS, Azure, or GCP).
  • Ensure data quality, integrity, and governance across multiple data sources.
  • Optimize SQL queries and database performance for large-scale datasets.
  • Collaborate with cross-functional teams to understand business requirements and translate

them into data engineering solutions.

  • Automate workflows and improve the efficiency of data operations.
  • Monitor, troubleshoot, and maintain data pipelines and infrastructure.

    • Required Skills & Qualifications :

  • 4 - 9 years of experience in data engineering or related roles.
  • Strong proficiency in SQL and Python.
  • Hands-on experience with ETL / ELT processes and tools.
  • Expertise in big data frameworks such as Hadoop, Spark.
  • Experience with cloud platforms like AWS, Azure, or GCP.
  • Good understanding of data modeling, data warehousing, and database design.
  • Familiarity with CI / CD pipelines and version control systems (e.g., Git).
  • Strong problem-solving, analytical, and communication skills.

    • Preferred Skills :

  • Knowledge of containerization technologies (Docker, Kubernetes).
  • Experience with workflow orchestration tools (e.g., Airflow, Luigi).
  • Exposure to real-time data streaming technologies (Kafka, Kinesis).
  • Understanding of data security and governance best practices.

    • Why Join Us :

  • Opportunity to work with cutting-edge big data and cloud technologies.
  • Dynamic and collaborative work environment.
  • Competitive salary and growth opportunities.

    • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Bangalore