Talent.com
Senior Data Engineer

Senior Data Engineer

DonyatiKolhapur, IN
20 hours ago
Job description

Senior Data Engineer

Job Title : Senior Data Engineer

Location : Remote / Willing to Travel

Job Type : Full-time

Experience Level : 8+ years

About the Role :

We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS. You will play a key role in transitioning from legacy systems to a scalable, cloud-native architecture using technologies like Apache Iceberg, AWS Glue, Redshift, and Atlan for governance. This role requires hands-on experience across both legacy (e.g., Siebel, Talend, Informatica) and modern data stacks.

Responsibilities :

  • Design, develop, and optimize data pipelines and ETL / ELT workflows on AWS.
  • Migrate legacy data solutions (Siebel, Talend, Informatica) to modern AWS-native services.
  • Implement and manage a data lake architecture using Apache Iceberg and AWS Glue.
  • Work with Redshift for data warehousing solutions including performance tuning and modeling.
  • Apply data quality and observability practices using Soda or similar tools.
  • Ensure data governance and metadata management using Atlan (or other tools like Collibra, Alation).
  • Collaborate with data architects, analysts, and business stakeholders to deliver robust data solutions.
  • Build scalable, secure, and high-performing data platforms supporting both batch and real-time use cases.
  • Participate in defining and enforcing data engineering best practices.

Required Qualifications :

  • 8+ years of experience in data engineering and data pipeline development.
  • Strong expertise with AWS services, especially Redshift, Glue, S3, and Athena.
  • Proven experience with Apache Iceberg or similar open table formats (like Delta Lake or Hudi).
  • Experience with legacy tools like Siebel, Talend, and Informatica.
  • Knowledge of data governance tools like Atlan, Collibra, or Alation.
  • Experience implementing data quality checks using Soda or equivalent.
  • Strong SQL and Python skills; familiarity with Spark is a plus.
  • Solid understanding of data modeling, data warehousing, and big data architectures.
  • Strong problem-solving skills and the ability to work in an Agile environment.
  • Expertise in Databricks, including designing and optimizing workflows within the Databricks environment.
    • Create a job alert for this search

    Senior Data Engineer • Kolhapur, IN