Talent.com
This job offer is not available in your country.
Lead Data Engineer - AWS RedShift

Lead Data Engineer - AWS RedShift

ResourcetreeChennai
9 hours ago
Job description

Job Description :

We are seeking a highly skilled and motivated Lead / Senior Data Engineer to join our. Data Integration and Analytics team. The ideal candidate will bring deep expertise in AWS Redshift, with strong knowledge of Redshift architecture, query performance tuning, and workload optimization.

You will be responsible for leading the design, development, and optimization of scalable ETL / ELT pipelines that enable efficient data integration and power critical business intelligence and analytics initiatives. This role requires a proven ability to troubleshoot complex data challenges, drive performance improvements, and ensure our data ecosystem is both scalable and cost-efficient. A passion for continuous learning, problem-solving, and enabling data-driven decision-making is highly valued.

Primary Skills : AWS,ETL Concepts, Data Integration Tool (Any)

Secondary Skills : Python, Datastage, Informatica IICS, Informatica, SSIS

Role Description :

The Lead Data Engineer will be responsible for overseeing the design, development, and maintenance of our data infrastructure and pipelines. This role requires strong technical expertise, leadership skills, and the ability to work collaboratively with cross-functional teams to ensure efficient and reliable data processes.

Role Responsibility :

  • Lead the design and architecture of scalable and robust data integration solutions on-premise and in the cloud.
  • Ensure solutions meet business requirements and industry standards.
  • Engage with executive leadership and key stakeholders to understand business needs and translate them into technical solutions.
  • Define data models, schemas, and structures to optimize data storage, retrieval, and processing for analytical workloads.
  • Work with data architects and solution architects to ensure alignment with overall data strategy and architecture principles.
  • Lead a team of data engineers by providing technical guidance, mentorship, and support.
  • Plan, prioritize, and manage data engineering projects, tasks, and timelines.
  • Design, develop, and maintain data integration pipelines and ETL / ELT workflows.
  • Lead more than one project or manage a larger team that might have sub-tracks.

Role Requirement :

  • Proficient in basic and advanced SQL.
  • Proficient in using Python for data integration and data engineering tasks.
  • Proficiency in ETL / ELT tools such as Informatica, Talend, DataStage, SSIS, DBT, Databricks, or equivalent.
  • Experience with relational databases (like SQL Server, Oracle, MySQL, PostgreSQL) and NoSQL databases (like MongoDB,
  • Cassandra), cloud databases (RedShift, Snowflake, Azure SQL).

  • Familiarity with big data technologies like Hadoop, Spark, Kafka, and cloud platforms such as AWS, Azure, or Google Cloud.
  • Solid understanding of data modeling, data warehousing concepts, and practices.
  • Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing dimensions etc.).
  • Knowledgeable in performance tuning and optimization
  • Experience in Data Profiling and Data validation
  • Experience in requirements gathering and documentation processes, and performing unit testing.
  • Understanding and implementing QA and various testing processes in the project.
  • Knowledge in any BI tools will be an added advantage.
  • Sound aptitude, outstanding logical reasoning, and analytical skills.
  • Willingness to learn and take initiative.
  • Ability to adapt toa fast-paced Agile environment.
  • Relevant certifications in data engineering or cloud platforms are a plus.
  • Additional Requirement :

  • Overall 6+ years in ETL / ELT (preferably Informatica IICS / Powercenter) and 3+ years of hands-on experience with AWS RedShift.
  • Strong proficiency in AWS Redshift and writing complex SQL queries.
  • Solid programming experience in Python for scripting, data wrangling, and automation.
  • Experience with version control tools like Git and CI / CD workflows.
  • Knowledge of data modeling and data warehousing concepts.
  • Prior experience with data lakes and big data technologies is a plus.
  • (ref : hirist.tech)

    Create a job alert for this search

    Aws Data Engineer • Chennai

    Related jobs
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesChennai, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer - IICS

    Senior Data Engineer - IICS

    ResourcetreeChennai
    Job Description : We are looking for a skilled and motivated Senior Data Engineer to join data integration and analytics...Show moreLast updated: 30+ days ago
    • Promoted
    Lead / Senior Data Engineer - ETL / AWS

    Lead / Senior Data Engineer - ETL / AWS

    ResourcetreeChennai
    We are seeking a highly skilled and motivated Lead / Senior Data Engineer to join our Data Integration and Analytics team. The ideal candidate will bring deep expertise in AWS Redshift, with strong kn...Show moreLast updated: 3 days ago
    • Promoted
    AWS Data Architect

    AWS Data Architect

    HCLTechChennai, India
    Kinldy share your availability.If your resume is shortlisted we will schedule your interview accordingly.We are seeking a highly skilled Senior AWS Data Engineer to join our data engineering team...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreeChennai, Tamil Nadu, India
    We are hiring for AWS Data Engineer.Notice period - immediate to 30 days.Seeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and impl...Show moreLast updated: 16 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsChennai, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Cynosure Corporate SolutionsChennai
    Key Responsibilities : - Design, develop, and maintain robust data pipelines to enable seamless data flow into Snowflake and other storage ...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Ashley Global Capability CenterChennai, Tamil Nadu, India
    Bachelor's or master’s degree in Computer Science, Mathematics, or related field.Years of experience in developing technology solutions, integrating, or creating AI and machine learning models.Know...Show moreLast updated: 30+ days ago
    • Promoted
    Accenture - AWS Data Engineer

    Accenture - AWS Data Engineer

    Accenture OperationChennai
    Management Level : 9- Consultant Location : Open Must-have skills : Data Engineering, AWS(mandate) Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, India
    Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer - Redshift, Pyspark, Glue

    AWS Data Engineer - Redshift, Pyspark, Glue

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Greetings from TATA Consultancy Services.Pls find the Job Description below.Good hands-on experience in Python programming and Pyspark. Data Engineering experience using AWS core services (Lambda, G...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    R Systemschennai, tamil nadu, in
    Offshore candidates accepted (Singapore Based Company).Please don't apply if less than 4 years exp in Data Engineer).ETL pipelines, real-time streaming, and data transformations.RDDs, transformatio...Show moreLast updated: 26 days ago
    • Promoted
    AmpsTek - AWS Data Engineer

    AmpsTek - AWS Data Engineer

    AmpstekChennai
    Job Role : AWS Data Location : Chennai / Bangalore / Hyderabad / Pune (Hybrid) Key Skills : A...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USAChennai, IN
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    10decodersChennai, Tamil Nadu, India
    Location : - Chennai, Hyderabad, Pune, Bangalore.Primary Skills : Python, Pyspark, Glue, Redshift, Lambda, DMS, RDS.Cloud Formation and other AWS serverless . Strong exp in SQL.Seeking a developer wh...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeChennai, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer(Chennai, Indore,Pune)

    AWS Data Engineer(Chennai, Indore,Pune)

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Good knowledge and experience in Pyspark for forming complex Transformation logic.Secondary : AWS Glue , Airflow.A minimum of 3 + years' experience and understanding of Python core concepts, and im...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incchennai, tamil nadu, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 18 days ago