Talent.com
Data Engineering - Gcp
Data Engineering - GcpEXL • Avadi, Thiruvallur (district), India
Data Engineering - Gcp

Data Engineering - Gcp

EXL • Avadi, Thiruvallur (district), India
5 hours ago
Job description

Responsibilities :

  • Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
  • Create the data integration and data diagram documentation.
  • Lead the data validation, UAT and regression test for new data asset creation.
  • Create and maintain data models, including schema design and optimization.
  • Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.

Qualifications and Skills :

  • Strong knowledge on Python and Pyspark
  • Expectation is to have ability to write Pyspark scripts for developing data workflows.
  • Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum
  • Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.
  • Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.
  • Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.
  • Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.
  • Expectation is to have strong problem-solving and troubleshooting skills.
  • Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.
  • Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.
  • 3-7 years of experience in Data Engineer.
  • Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL.
  • Experience in GCP computing platform, such as developing ETL processes
  • Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.
  • Create a job alert for this search

    Data Engineering • Avadi, Thiruvallur (district), India

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data Solutions • Ambattur, Thiruvallur (district), India
    Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Manager -Data Analytics, Science & Ai Enablement

    Senior Manager -Data Analytics, Science & Ai Enablement

    Chargebee • Avadi, Thiruvallur (district), India
    Chargebee is seeking a visionary and hands-on Director of Data Analytics, Science & AI Enablement to lead the creation and growth of a data function that powers enterprise-wide AI initiatives.This ...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Dbt (Data Build Tool) Engineer

    Senior Dbt (Data Build Tool) Engineer

    Ascendion • Avadi, Thiruvallur (district), India
    Job Description : Senior DBT Engineer (8–12 Years).Senior Data Engineer with strong ELT experience.Focus on building scalable, efficient, and well-governed DBT data models on modern cloud platforms.Show more
    Last updated: 5 hours ago • Promoted • New!
    Data Scientist

    Data Scientist

    Infosys Finacle • Ambattur, Thiruvallur (district), India
    Minimum 4+years of Experience required.Excellent analytical and problem-solving skills.Experience using statistical computer languages (Python, SLQ, etc. Knowledge of advanced statistical techniques...Show more
    Last updated: 5 hours ago • Promoted • New!
    Technical Lead

    Technical Lead

    UNCIA • Avadi, Thiruvallur (district), India
    We’re looking for a passionate Technology Lead / Engineering Manager to join our growing team and help build enterprise-grade banking products using. NET Core, Angular, and a modern microservices ar...Show more
    Last updated: 5 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    JMAN Group • Ambattur, Thiruvallur (district), India
    JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show more
    Last updated: 5 hours ago • Promoted • New!
    Informatica Lead

    Informatica Lead

    Mastech Digital • Ambattur, Thiruvallur (district), India
    Chennai / Hyderabad / Bangalore / Remote.Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days. The ideal candidate will lead development teams, design robust ETL solutions,...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Spocto X (A Yubi Company) • Avadi, Thiruvallur (district), India
    Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the d...Show more
    Last updated: 5 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    HCLTech • Ambattur, Thiruvallur (district), India
    Available Location - Chennai, Bangalore, Hyderabad.Skills required : GCP, Big Query, SQL, Python, Dataflow or Dataproc, Airflow or Cloud composer, DBT, Looker. Notice Period - Immediate joiner to 60 ...Show more
    Last updated: 5 hours ago • Promoted • New!
    Gcp Data Engineer(Only Immediate)

    Gcp Data Engineer(Only Immediate)

    R Systems • Ambattur, Tamil Nadu, India
    About the role–- As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learning at scale.You'll ...Show more
    Last updated: 1 day ago • Promoted
    Big Data Developer - Spark

    Big Data Developer - Spark

    HCLTech • Avadi, Thiruvallur (district), India
    Position : Senior Data Engineer – Experience : 6–9 Years.We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kuberne...Show more
    Last updated: 5 hours ago • Promoted • New!
    Lead Ai Engineer

    Lead Ai Engineer

    Blend • Ambattur, Thiruvallur (district), India
    We are looking for a Manager / Lead AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edg...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Technical Lead - Db2 Dba

    Senior Technical Lead - Db2 Dba

    HCLTech • Avadi, Thiruvallur (district), India
    Expert knowledge of DB2 version 11 / 12 on the z / OS platform.Ability to work within a team environment and communicate effectively with others. Represent the database team in application development p...Show more
    Last updated: 5 hours ago • Promoted • New!
    Lead - Delivery Automation & Ai Enablement

    Lead - Delivery Automation & Ai Enablement

    Mastech Digital • Ambattur, Thiruvallur (district), India
    Lead – Delivery Automation & AI Enablement.Immediate joiner / Serving notice with less than 60 days / Notice is less than 45 days. Lead – Delivery Automation & AI Enablement.This role will focus on emb...Show more
    Last updated: 5 hours ago • Promoted • New!
    Etl Developer - Data Engineering

    Etl Developer - Data Engineering

    Theron Solutions • Avadi, Thiruvallur (district), India
    We are seeking a highly skilled ETL Developer with 5–8 years of experience in data integration, transformation, and pipeline optimization. This role is a key part of our Data Engineering function wi...Show more
    Last updated: 5 hours ago • Promoted • New!
    Principal Architect- Data Engineering (Gen Ai)

    Principal Architect- Data Engineering (Gen Ai)

    Tiger Analytics • Avadi, Thiruvallur (district), India
    Principal Architect – Data Engineering (Gen AI CoE).Location : Chennai / Bangalore / Hyderabad.Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest...Show more
    Last updated: 3 hours ago • Promoted • New!
    Tech Process Analyst

    Tech Process Analyst

    Indsafri • Avadi, Thiruvallur (district), India
    Job Tile : Tech Process Analyst – Banking & Software Delivery.We are looking for a Tech Process Analyst to support the organization in diagnosing and resolving challenges within the software develop...Show more
    Last updated: 5 hours ago • Promoted • New!
    Data Scientist

    Data Scientist

    Canvendor • Avadi, Thiruvallur (district), India
    Data Scientist (1+ Years Experience) |.Notice Period : Immediate to 30 Days.Collect, clean, and preprocess structured and unstructured data from various sources. Build, evaluate, and deploy statistic...Show more
    Last updated: 5 hours ago • Promoted • New!