Talent.com
Opportunity for Data Engineer

Opportunity for Data Engineer

Hinduja Tech LimitedPune, Maharashtra, India
30+ days ago
Job description
  • 8+ years of experience in data engineering or a related field.
  • Strong hands-on experience with Azure Databricks , Spark , Python / Scala, CICD, Scripting for data processing.
  • Experience working in multiple file formats like Parquet , Delta , and Iceberg .
  • Knowledge of Kafka or similar streaming technologies for real-time data ingestion.
  • Experience with data governance and data security in Azure.
  • Deep understanding of Azure Data Services (e.g., Azure Blob Storage, Azure Data Lake, Azure SQL Data Warehouse, Event Hubs, Functions etc.).
  • Familiarity with data lakes , data warehouses , and modern data architectures.
  • Experience with CI / CD pipelines , version control (Git), Jenkins and agile methodologies.
  • Understanding of cloud infrastructure and architecture principles (especially within Azure ).
  • Technical Skills :
  • Expert-level proficiency in Spark, SPARK Streaming , including optimization, debugging, and troubleshooting Spark jobs.
  • Solid knowledge of Azure Databricks for scalable, distributed data processing.
  • Strong coding skills in Python and Scala for data processing.
  • Experience working with SQL , especially for large datasets.
  • Knowledge of data formats like Iceberg , Parquet , ORC , and Delta Lake
  • Create a job alert for this search

    Data Engineer • Pune, Maharashtra, India