Description :
Role : Sr Data Engineer
Experience : 4+yrs
Location : Bengaluru
Notice Period : Immediate Joiner or max 15days preferred
Skills : Hive, Spark, Airflow, Oracle OCI Big Data, Data Lake, Sqoop, File Processing, Pipeline Support
Key Responsibilities :
- Develop and optimize ETL / ELT pipelines using Spark, Hive, and Airflow
- Manage data ingestion workflows including Sqoop transfers (Oracle ? Hive) and file-based processing
- Monitor, debug, and support production data pipelines and batch workflows
- Work with OCI Big Data Service, Data Lake, and distributed storage systems
- Perform performance tuning and troubleshoot issues across Spark jobs, Hive queries, and Airflow DAGs
Required Skills :
4+ years of Data Engineering experienceStrong in Spark (PySpark / Scala), Hive, SQL, and LinuxHands-on experience with Airflow, Sqoop, and file ingestionExperience working on OCI Big Data / Data Lake platformsStrong debugging and pipeline support capabilitiesNice to Have :
Knowledge of Informatica, HDFS, or Cloud Data Integration toolsGood understanding of CI / CD, Git, and scripting(ref : hirist.tech)