Data Engineer

Data Engineer | 4+ Years | Bangalore / Hyderabad

Location: Bangalore / Hyderabad

Experience: 4+ Years

About the Role

We are looking for a skilled Data Engineer to design, develop, and maintain scalable data pipelines while building automated solutions that streamline business processes. The ideal candidate should have strong expertise in big data technologies, Python, SQL, and cloud-scale data processing.

Key Responsibilities

• Design, build, and maintain scalable ETL/data pipelines.
• Develop and optimize data processing using Spark, PySpark, Hive, and Presto.
• Write efficient SQL queries and Python scripts for data processing and automation.
• Build, deploy, debug, and optimize data pipelines.
• Implement data quality checks to identify duplicates, null values, and data drift.
• Collaborate with cross-functional teams to gather requirements and deliver automation solutions.
• Maintain dashboards and business-critical reporting metrics.
• Monitor pipeline performance and continuously improve reliability and efficiency.
• Work with upstream and downstream teams to ensure seamless data flow.
• Follow best practices for software development, testing, version control, and documentation.

Required Skills

• Python
• SQL
• Apache Spark / PySpark
• Apache Hive
• Apache Airflow
• Presto
• ETL & Data Pipeline Development
• Data Quality & Validation
• Git & Jira
• Distributed Data Processing

Preferred Skills

• Kafka
• Tableau
• Grafana
• Google Dash Studio
• Experience with large-scale distributed systems

Qualifications

• Bachelor's degree in Computer Science or a related field.
• 4+ years of experience in Data Engineering.
• Strong problem-solving, analytical, and communication skills.

If you're passionate about building scalable data solutions and working with modern data engineering technologies, we'd love to hear from you.

Interested candidates can share their updated resume with their current CTC, expected CTC, notice period, and current location.

Skills Required
Git, Apache Hive, Apache Spark, Pyspark, Presto, Sql, Apache Airflow, Jira, Python