Talent.com
This job offer is not available in your country.
Data Engineer - ETL / Python

Data Engineer - ETL / Python

Coders Brain Technology Private LimitedBangalore
30+ days ago
Job description

Job Title : Data Engineer-

Location : Bangalore, India-

Experience : 5-7 Years-

Job Summary :

We are seeking a skilled - Data Engineer- with - 5-7 years of experience- in designing, building, and maintaining data pipelines. The ideal candidate should have strong expertise in - Python and PySpark- , along with experience working with big data technologies and cloud platforms.

Key Responsibilities :

  • Design, develop, and maintain scalable - ETL / ELT pipelines- for data ingestion and processing.
  • Work with - PySpark- and - Python- to implement efficient data transformation logic.
  • Optimize and troubleshoot - big data workflows- for performance and reliability.
  • Collaborate with - Data Scientists, Analysts, and Business teams- to understand data requirements.
  • Manage and process large-scale structured and unstructured datasets.
  • Ensure - data quality, governance, and security- across all data pipelines.
  • Work with - cloud platforms (AWS / Azure / GCP)- for data storage and processing.
  • Monitor and improve - database performance, indexing, and query execution- .

Required Skills :

  • Strong hands-on experience with - Python- and - PySpark- .
  • Proficiency in - SQL- and relational databases.
  • Experience with - big data frameworks- such as - Apache Spark, Hadoop- .
  • Familiarity with - cloud-based data services- (AWS, Azure, GCP).
  • Expertise in - ETL processes- and - data pipeline orchestration- .
  • Strong problem-solving skills and ability to optimize data workflows.
  • Preferred Skills :

  • Experience with - workflow orchestration tools- (Airflow, Luigi, etc.).
  • Knowledge of - NoSQL databases- (MongoDB, Cassandra, etc.).
  • Exposure to - Kafka, Kinesis, or similar streaming platforms- .
  • Understanding of - data security and governance best practices- .
  • Educational Qualification :

  • Bachelor's or Master's degree- in Computer Science, Information Technology, or a related field.
  • Why Join Us ?

  • Opportunity to work on cutting-edge - big data projects- .
  • Collaborative and growth-oriented work environment.
  • Competitive compensation and - career development opportunities- .
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Bangalore

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Aceolutionhosur, tamil nadu, in
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 8 days ago
    • Promoted
    ETL Developer

    ETL Developer

    Pinnacle Group, Inc.hosur, tamil nadu, in
    PTR Global is a leader in providing innovative workforce solutions, dedicated to optimizing talent acquisition and management processes. Our commitment to excellence has earned us the trust of busin...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Developer – EMDA Analytics (ETL, Biovia Pipeline Pilot)

    Senior Developer – EMDA Analytics (ETL, Biovia Pipeline Pilot)

    Tech One IThosur, tamil nadu, in
    We are seeking a highly skilled.EMDA (Environmental Monitoring Data Analytics) team.The role focuses on developing, deploying, and maintaining ETL workflows for a. Pfizer’s global manufacturing site...Show moreLast updated: 8 hours ago
    • Promoted
    ETL LEAD with IBM DataStage experienced

    ETL LEAD with IBM DataStage experienced

    IntraEdgehosur, tamil nadu, in
    ETL Developer – DataStage, AWS, Snowflake.We are looking for a talented and motivated ETL Developer / Senior Developer.You will work on building scalable and efficient data pipelines using.IBM Data...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesBengaluru, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh Technologieshosur, tamil nadu, in
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 20 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIhosur, tamil nadu, in
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer (Databricks)

    Data Engineer (Databricks)

    VSquare Systems Pvt. Ltd.Bengaluru, Karnataka, India
    We are looking for a highly skilled.In this role, you will be instrumental in designing, developing, and maintaining ETL processes to ensure efficient extraction, transformation, and loading of dat...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicesbangalore district, karnataka, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    TechVeritohosur, tamil nadu, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 8 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    BayRock LabsBengaluru, Karnataka, India
    Debug and resolve issues in data pipelines and workflows.Python (ETL / ELT, data handling).GitHub Actions, GitLab CI, Jenkins, etc. Workflow orchestration tools (.Knowledge on any ERP & the business p...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHhosur, tamil nadu, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 29 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
    • Promoted
    ETL Developer

    ETL Developer

    Rrootshell Technologiiss Pvt LtdBengaluru, Karnataka, India
    Hope you are doing well & Safe!.Rrootshell Technologiiss Pvt Ltd.We are HIRING & URGENT Requirement for.ETL / Data Engineer – Data Migration. This is for FULL -TIME role and Remote Work Opportunity.Hi...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 Companyhosur, tamil nadu, in
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.hosur, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgehosur, tamil nadu, in
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIhosur, tamil nadu, in
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 6 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data Solutionshosur, tamil nadu, in
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalhosur, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago