Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

CozzeraKolhapur, IN
3 days ago
Job description

Job Title : Data Engineer

Experience : 6+ Years

Location : Remote

Employment Type : Full-Time

Job Summary :

We are seeking a highly skilled and experienced Data Engineer with a strong background in building and optimizing data pipelines, architectures, and data sets. The ideal candidate should have 6+ years of hands-on experience in data engineering, with mandatory expertise in both AWS and Azure cloud platforms . This is a remote position, offering flexibility and the opportunity to work with a global team.

Key Responsibilities :

  • Design, develop, and maintain robust, scalable, and efficient data pipelines and ETL / ELT processes.
  • Integrate data from various structured and unstructured sources into data lakes and data warehouses.
  • Develop and optimize data architectures on AWS (S3, Glue, Redshift, Lambda, Athena) and Azure (Data Lake, Data Factory, Synapse, Databricks) .
  • Implement data quality, lineage, and observability frameworks.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver reliable solutions.
  • Monitor and troubleshoot production data pipelines and ensure data integrity.
  • Apply best practices in data engineering, security, and governance.

Mandatory Skills :

  • Cloud Platforms :
  • Strong hands-on experience with AWS services like S3, Glue, Redshift, Lambda, Athena, EMR.
  • Deep knowledge of Azure services such as Azure Data Factory, Azure Data Lake Storage, Synapse Analytics, Azure Databricks.
  • Programming Languages :
  • Proficiency in Python , SQL , and PySpark for building ETL pipelines.
  • Data Processing Frameworks :
  • Experience with Apache Spark , Databricks , and Airflow or similar workflow orchestration tools.
  • Data Modeling :
  • Strong understanding of relational and dimensional data modeling, data warehousing concepts.
  • DevOps / DataOps :
  • Familiarity with CI / CD pipelines, Git, Docker, and Infrastructure as Code (Terraform / CloudFormation).
  • Create a job alert for this search

    Data Engineer • Kolhapur, IN