Job Title : Data Engineer-
Location : Bangalore, India-
Experience : 5-7 Years-
Job Summary :
We are seeking a skilled - Data Engineer- with - 5-7 years of experience- in designing, building, and maintaining data pipelines. The ideal candidate should have strong expertise in - Python and PySpark- , along with experience working with big data technologies and cloud platforms.
Key Responsibilities :
- Design, develop, and maintain scalable - ETL / ELT pipelines- for data ingestion and processing.
- Work with - PySpark- and - Python- to implement efficient data transformation logic.
- Optimize and troubleshoot - big data workflows- for performance and reliability.
- Collaborate with - Data Scientists, Analysts, and Business teams- to understand data requirements.
- Manage and process large-scale structured and unstructured datasets.
- Ensure - data quality, governance, and security- across all data pipelines.
- Work with - cloud platforms (AWS / Azure / GCP)- for data storage and processing.
- Monitor and improve - database performance, indexing, and query execution- .
Required Skills :
Strong hands-on experience with - Python- and - PySpark- .Proficiency in - SQL- and relational databases.Experience with - big data frameworks- such as - Apache Spark, Hadoop- .Familiarity with - cloud-based data services- (AWS, Azure, GCP).Expertise in - ETL processes- and - data pipeline orchestration- .Strong problem-solving skills and ability to optimize data workflows.Preferred Skills :
Experience with - workflow orchestration tools- (Airflow, Luigi, etc.).Knowledge of - NoSQL databases- (MongoDB, Cassandra, etc.).Exposure to - Kafka, Kinesis, or similar streaming platforms- .Understanding of - data security and governance best practices- .Educational Qualification :
Bachelor's or Master's degree- in Computer Science, Information Technology, or a related field.Why Join Us ?
Opportunity to work on cutting-edge - big data projects- .Collaborative and growth-oriented work environment.Competitive compensation and - career development opportunities- .(ref : hirist.tech)