Talent.com
Data Engineer (GCP+Terraform+Tekton+Python+PySpark)

Data Engineer (GCP+Terraform+Tekton+Python+PySpark)

TekWissen IndiaChennai, Tamil Nadu, India
1 day ago
Job description

Overview :

TekWissen is a global workforce management provider throughout India and many other countries in the world. The below client is a global company with shared ideals and a deep sense of family. From our earliest days as a pioneer of modern transportation, we have sought to make the world a better place – one that benefits lives, communities and the planet

Job Title : Data Engineering Engineer II

Location : Chennai

Work Type : Hybrid

Position Description :

  • We are looking for a passionate and hands-on Data Engineer to work with one of our direct clients in Chennai.
  • The ideal candidate must have strong experience in building scalable data pipelines and working on GCP-based data platforms.

Key Skills

  • GCP : BigQuery, Dataflow, Dataproc, Data Fusion, Cloud SQL
  • Orchestration : Airflow
  • Programming : Python, PySpark
  • IaC / CI-CD : Terraform, Tekton
  • Database & Others : Postgres, SQL, API Integrations
  • Responsibilities

  • Build and maintain scalable, reliable data pipelines
  • Design and optimize data platforms (Data Warehouse, Data Lake, Lakehouse)
  • Collaborate with cross-functional teams on data requirements
  • Automate workflows and improve system performance
  • Ideal Candidate

  • 4+ years of Data Engineering experience
  • Strong hands-on experience with Airflow, Terraform, Tekton, GCP
  • TekWissen® Group is an equal opportunity employer supporting workforce diversity.

    Create a job alert for this search

    Data Engineer • Chennai, Tamil Nadu, India

    Related jobs
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticschennai, tamil nadu, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 19 days ago
    • Promoted
    Python API + Data Engineer

    Python API + Data Engineer

    Digitrix Software LLPchennai, tamil nadu, in
    API development and large-scale data processing.Write clean, testable, and scalable code with.S3, Athena, Glue, EMR, SageMaker) for data engineering and model deployment. Collaborate cross-functiona...Show moreLast updated: 19 days ago
    • Promoted
    Contract Role - 6 months to 1 year - Senior Data Engineer - Python, AWS, Building Data Pipelines

    Contract Role - 6 months to 1 year - Senior Data Engineer - Python, AWS, Building Data Pipelines

    CareerXperts Consultingchennai, tamil nadu, in
    Our client is looking for a talented experienced software development consultants, specializing in Agile Delivery.A place where you are a polyglot, working alongside the client,.A world where you a...Show moreLast updated: 23 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Coffeee.iochennai, tamil nadu, in
    Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 15 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionChennai, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 1 day ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    The Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations. Location - Kolkata / Chennai / Trivan...Show moreLast updated: 11 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    K&K Talents - IndiaChennai, IN
    This position is with one of our.Title : Principal Data Engineer.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune. Employment Type : Full-time Permanent.GCP or AWS, Spark, Pyspa...Show moreLast updated: 11 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGChennai, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDchennai, tamil nadu, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 21 days ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPChennai, IN
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantChennai, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 1 day ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy Serviceschennai, tamil nadu, in
    Notice Period- 0 to 15 days / Serving Notice period.Skills : GCP, PySpark, Python, HDFS, Hadoop, SQL.Good Hands on knowledge on GCP. Should have worked on Data Migration projects, from On-prem to Clo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softchennai, tamil nadu, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer - ETL / PySpark

    Data Engineer - ETL / PySpark

    Ixceed SolutionsChennai
    Role : Data Engineer Location : Chennai (Hybrid).Job Description : Key Responsibilities : Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    9NEXUSchennai, tamil nadu, in
    Job Title : Azure Data Engineer.We are seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions in a cloud environment. The role involves building high-perf...Show moreLast updated: 15 hours ago
    • Promoted
    Senior Data Engineer - Python / PySpark

    Senior Data Engineer - Python / PySpark

    Digivance SolutionChennai
    Job Title : Senior Data Engineer Location : Chennai (Hybrid 4 days from office per week) Experience ...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Scala / Spark / Python

    Big Data Engineer - Scala / Spark / Python

    Idyllic Services Pvt LtdChennai
    Job Title : Big Data Engineer - Scala Experience : 7 to 10Years (Minimum 3+ years in Scala) Notice Period : ...Show moreLast updated: 30+ days ago
    • Promoted
    Colan Infotech - Azure Data Engineer - PySpark / Python

    Colan Infotech - Azure Data Engineer - PySpark / Python

    Colan Infotech Pvt LtdChennai
    Position : Azure Data Engineer Experience : 3-5 Years Job Type : Full-time Job Summary : We are seeking a skilled...Show moreLast updated: 19 days ago