Talent.com
Data Engineer

Data Engineer

NexionPro Serviceshosur, tamil nadu, in
8 hours ago
Job description

Job Title : Data Engineer

Experience : 5–10 Years

Location : Bangalore (ONLY)

Mandatory Skills : SQL, ETL, PySpark, Python

Key Responsibilities

  • Design, develop, and maintain scalable ETL / ELT pipelines to ingest and transform large datasets from diverse sources.
  • Build and optimize PySpark-based data processing workflows for batch and real-time data use cases.
  • Write high-performance SQL queries and manage complex data models for analytics and reporting.
  • Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.
  • Ensure data quality, accuracy, and reliability through robust validation and monitoring frameworks.
  • Optimize data storage and processing performance on cloud or distributed systems.
  • Implement automation for recurring tasks using Python and related tools.
  • Work with CI / CD pipelines and version control to maintain clean, scalable, and maintainable code.
  • Troubleshoot and resolve issues in data pipelines, ensuring minimal disruption to business operations.

Required Skills & Qualifications

  • 5–10 years of hands-on experience in Data Engineering .
  • Strong proficiency in SQL , including complex queries, performance tuning, and data modeling.
  • Expertise in ETL / ELT development , data integration, and transformation frameworks.
  • Solid experience in PySpark for distributed data processing.
  • Strong programming experience in Python , including writing modular, production-grade code.
  • Experience working with big data ecosystems (e.g., Hadoop, Hive, Spark).
  • Familiarity with data warehousing concepts and cloud platforms (AWS / Azure / GCP).
  • Experience with version control (Git), CI / CD, and workflow orchestration tools (Airflow / Luigi) is a plus.
  • Strong analytical, problem-solving, and communication skills.
  • Create a job alert for this search

    Data Engineer • hosur, tamil nadu, in