Job Title : Data Engineer
Location : Gurgaon
Experience : 4–5 Years
Notice Period : Immediate joiner only
About the Role :
We are seeking a skilled and motivated Data Engineer with 4–5 years of hands-on experience in data processing, scripting, and data pipeline development. You will play a key role in designing, building, and maintaining scalable data workflows that power analytics and business decisions.
Key Responsibilities :
- Design, build, and optimize scalable data pipelines for batch processing.
- Develop and maintain scripts for data extraction, transformation, and loading (ETL).
- Perform data cleansing, validation, and standardization using Python and Shell scripting.
- Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements.
- Automate repetitive data tasks using batch and shell scripting tools.
- Monitor, troubleshoot, and improve data workflows to ensure reliability and performance.
- Ensure data quality and compliance with security and governance requirements.
Required Skills :
Proficiency in Python for data handling and scripting tasks.Strong experience with Batch Scripting and Shell Scripting on Unix / Linux platforms.Solid understanding of Data Pre-processing techniques (e.g., cleansing, transformation, normalization).Experience working with large datasets and handling data from multiple sources.Familiarity with version control tools like Git and job scheduling tools like Cron , Airflow , or similar.Good understanding of file formats such as CSV, JSON, Parquet, etc.Good to Have :
Exposure to cloud platforms like AWS, Azure, or GCP.Knowledge of data warehousing concepts.Basic knowledge of SQL and relational databases.Understanding of CI / CD for data pipelines.