Talent.com
Data Engineering - Gcp
Data Engineering - GcpEXL • Avadi, Thiruvallur (district), India
Data Engineering - Gcp

Data Engineering - Gcp

EXL • Avadi, Thiruvallur (district), India
1 hour ago
Job description

Responsibilities :

  • Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
  • Create the data integration and data diagram documentation.
  • Lead the data validation, UAT and regression test for new data asset creation.
  • Create and maintain data models, including schema design and optimization.
  • Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.

Qualifications and Skills :

  • Strong knowledge on Python and Pyspark
  • Expectation is to have ability to write Pyspark scripts for developing data workflows.
  • Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum
  • Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.
  • Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.
  • Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.
  • Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.
  • Expectation is to have strong problem-solving and troubleshooting skills.
  • Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.
  • Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.
  • 3-7 years of experience in Data Engineer.
  • Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL.
  • Experience in GCP computing platform, such as developing ETL processes
  • Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.
  • Create a job alert for this search

    Data Engineering • Avadi, Thiruvallur (district), India

    Related jobs
    Machine Learning Engineer

    Machine Learning Engineer

    Zillwork • Ambattur, Thiruvallur (district), India
    As an ML Engineer, you will design and develop : .Geolocation-based ML components.Embedding-based similarity systems.Data preprocessing and model evaluation workflows. NLP experience (HuggingFace, BER...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Support Analyst

    Senior Support Analyst

    BNP Paribas • Ambattur, Thiruvallur (district), India
    Unix, Shell scripting, SQL, Dynatrace or any other monitoring tool (configuration), Autosys or any other scheduling tool, DevOps. This is for a Lead Support Analyst role, reporting to the Applicatio...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data Solutions • Ambattur, Thiruvallur (district), India
    Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Manager -Data Analytics, Science & Ai Enablement

    Senior Manager -Data Analytics, Science & Ai Enablement

    Chargebee • Avadi, Thiruvallur (district), India
    Chargebee is seeking a visionary and hands-on Director of Data Analytics, Science & AI Enablement to lead the creation and growth of a data function that powers enterprise-wide AI initiatives.This ...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Dbt (Data Build Tool) Engineer

    Senior Dbt (Data Build Tool) Engineer

    Ascendion • Avadi, Thiruvallur (district), India
    Job Description : Senior DBT Engineer (8–12 Years).Senior Data Engineer with strong ELT experience.Focus on building scalable, efficient, and well-governed DBT data models on modern cloud platforms.Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Scientist

    Data Scientist

    Infosys Finacle • Ambattur, Thiruvallur (district), India
    Minimum 4+years of Experience required.Excellent analytical and problem-solving skills.Experience using statistical computer languages (Python, SLQ, etc. Knowledge of advanced statistical techniques...Show more
    Last updated: 1 hour ago • Promoted • New!
    Technical Lead

    Technical Lead

    UNCIA • Avadi, Thiruvallur (district), India
    We’re looking for a passionate Technology Lead / Engineering Manager to join our growing team and help build enterprise-grade banking products using. NET Core, Angular, and a modern microservices ar...Show more
    Last updated: 1 hour ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    JMAN Group • Ambattur, Thiruvallur (district), India
    JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show more
    Last updated: 1 hour ago • Promoted • New!
    Informatica Lead

    Informatica Lead

    Mastech Digital • Ambattur, Thiruvallur (district), India
    Chennai / Hyderabad / Bangalore / Remote.Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days. The ideal candidate will lead development teams, design robust ETL solutions,...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Spocto X (A Yubi Company) • Avadi, Thiruvallur (district), India
    Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the d...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Engineer

    Data Engineer

    HCLTech • Ambattur, Thiruvallur (district), India
    Available Location - Chennai, Bangalore, Hyderabad.Skills required : GCP, Big Query, SQL, Python, Dataflow or Dataproc, Airflow or Cloud composer, DBT, Looker. Notice Period - Immediate joiner to 60 ...Show more
    Last updated: 1 hour ago • Promoted • New!
    Gcp Data Engineer(Only Immediate)

    Gcp Data Engineer(Only Immediate)

    R Systems • Ambattur, Tamil Nadu, India
    About the role–- As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learning at scale.You'll ...Show more
    Last updated: 1 day ago • Promoted
    Big Data Developer - Spark

    Big Data Developer - Spark

    HCLTech • Avadi, Thiruvallur (district), India
    Position : Senior Data Engineer – Experience : 6–9 Years.We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kuberne...Show more
    Last updated: 1 hour ago • Promoted • New!
    Hcl Is Hiring Senior Cloud Engineer@Chennai

    Hcl Is Hiring Senior Cloud Engineer@Chennai

    HCLTech • Ambattur, Thiruvallur (district), India
    We are looking for Cloud Engineer for one of our Client.Be able to learn and work with programming languages such as GoLang, Python, and Bash scripting for building automation that integrates with ...Show more
    Last updated: 1 hour ago • Promoted • New!
    Lead Ai Engineer

    Lead Ai Engineer

    Blend • Ambattur, Thiruvallur (district), India
    We are looking for a Manager / Lead AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edg...Show more
    Last updated: 1 hour ago • Promoted • New!
    Lead - Delivery Automation & Ai Enablement

    Lead - Delivery Automation & Ai Enablement

    Mastech Digital • Ambattur, Thiruvallur (district), India
    Lead – Delivery Automation & AI Enablement.Immediate joiner / Serving notice with less than 60 days / Notice is less than 45 days. Lead – Delivery Automation & AI Enablement.This role will focus on emb...Show more
    Last updated: 1 hour ago • Promoted • New!
    Etl Developer - Data Engineering

    Etl Developer - Data Engineering

    Theron Solutions • Avadi, Thiruvallur (district), India
    We are seeking a highly skilled ETL Developer with 5–8 years of experience in data integration, transformation, and pipeline optimization. This role is a key part of our Data Engineering function wi...Show more
    Last updated: 1 hour ago • Promoted • New!
    Tech Process Analyst

    Tech Process Analyst

    Indsafri • Avadi, Thiruvallur (district), India
    Job Tile : Tech Process Analyst – Banking & Software Delivery.We are looking for a Tech Process Analyst to support the organization in diagnosing and resolving challenges within the software develop...Show more
    Last updated: 1 hour ago • Promoted • New!