Talent.com
This job offer is not available in your country.
Lead Data Engineer - ETL / Python

Lead Data Engineer - ETL / Python

FirstcareercentreBangalore
5 days ago
Job description

Roles & Responsibilities :

  • Design, develop, and maintain data pipelines for ingestion, processing, and storage using SQL, Python, and Big Data technologies.
  • Build scalable solutions on Google BigQuery and manage large datasets efficiently.
  • Collaborate with Data Scientists, Analysts, and Business teams to understand requirements and deliver actionable data insights.
  • Optimize SQL queries, Python scripts, and BigQuery jobs for performance and cost efficiency.
  • Implement data governance, quality checks, and security standards across all data assets.
  • Monitor and troubleshoot ETL pipelines and data workflows to ensure reliability.
  • Participate in architecture discussions and recommend best practices for Big Data solutions.

Required Skills :

  • Strong experience in SQL, Python, and Big Data frameworks (Hadoop, Spark, or similar).
  • Hands-on experience with Google BigQuery and cloud-based data platforms.
  • Expertise in ETL / ELT processes and data warehousing concepts.
  • Experience with data modeling, data pipelines, and large-scale data processing.
  • Knowledge of cloud platforms (GCP, AWS, or Azure) is a plus.
  • Strong problem-solving, analytical, and communication skills.
  • Desired Skills :

  • Familiarity with Airflow, Dataflow, or other workflow orchestration tools.
  • Experience with BI tools like Tableau, Looker, or Power BI.
  • Certification in Google Cloud Data Engineering is a plus
  • (ref : hirist.tech)

    Create a job alert for this search

    Lead Data Engineer • Bangalore

    Related jobs
    • Promoted
    ETL Developer

    ETL Developer

    Pinnacle Group, Inc.hosur, tamil nadu, in
    PTR Global is a leader in providing innovative workforce solutions, dedicated to optimizing talent acquisition and management processes. Our commitment to excellence has earned us the trust of busin...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Aceolutionhosur, tamil nadu, in
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionshosur, tamil nadu, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 25 days ago
    • Promoted
    Senior Manager - Data Engineering Lead

    Senior Manager - Data Engineering Lead

    DIAGEO Indiahosur, tamil nadu, in
    Senior Manager - Data Engineering Lead.Bachelor’s or master’s degree in computer science, Data Engineering, or related field. Experience in data engineering.Proven experience in cloud platforms (AWS...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesBengaluru, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh Technologieshosur, tamil nadu, in
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 20 days ago
    • Promoted
    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    Scala Big Data Lead Engineer - 7 YoE - Immediate Joiner - Any UST Location

    USThosur, tamil nadu, in
    CTC, notice period, and current location details to.Apache Hadoop, Airflow, Kubernetes, and Containers.Troubleshoot Hadoop log files and work with. Required Skills & Qualifications : .Scala, Spark, Py...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekhosur, tamil nadu, in
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Lead Data Engineer & ML Analyst

    Lead Data Engineer & ML Analyst

    Eltropyhosur, tamil nadu, in
    We’re looking for someone with.Design and manage scalable ETL / ELT pipelines using AWS Glue, Redshift, S3, and Kafka / Kinesis. Architect and implement data lake and warehouse solutions following best ...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer— @Meta

    Data Engineer— @Meta

    SRISAN GROUP INChosur, tamil nadu, in
    Hiring : Data Engineer @ Meta – Offshore Team (Remote, Full-Time / Contract, Hyderabad, Telangana).Location : Hyderabad, Telangana. LPA – ₹48 LPA (depends on experience).Experience : 2+ years (Multiple P...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    SnapLogic ETL & Python Lead

    SnapLogic ETL & Python Lead

    Swift Strategic Solutions IncBengaluru, Karnataka, India
    Our technology services client is seeking multiple.These positions offer a strong potential for conversion to full-time employment upon completion of the initial contract period.Below are further d...Show moreLast updated: 14 hours ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreeshosur, tamil nadu, in
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 26 days ago
    • Promoted
    Technical Lead - Data Engineer

    Technical Lead - Data Engineer

    Visara PartnersBengaluru, Karnataka, India
    Location : Bengaluru / Hyderabad.Databricks workflow & Unity catalog.Python programming & package builds.Hands-on experience in designing and building scalable data pipelines using Databricks with ...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight Globalhosur, tamil nadu, in
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on LinkedIn with resume. Design, develop, and maintai...Show moreLast updated: 30+ days ago
    • Promoted
    ETL Developer

    ETL Developer

    Rrootshell Technologiiss Pvt Ltdbangalore, karnataka, in
    Hope you are doing well & Safe!.Rrootshell Technologiiss Pvt Ltd.We are HIRING & URGENT Requirement for.ETL / Data Engineer – Data Migration. This is for FULL -TIME role and Remote Work Opportunity.Hi...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHhosur, tamil nadu, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 29 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Inchosur, tamil nadu, in
    Following are high level responsibilities that you will play but not limited to : .Analyze the Data Model and do GAP analysis with Business Requirements and Power BI. Design and Model Power BI schema....Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIhosur, tamil nadu, in
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgehosur, tamil nadu, in
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran Systemshosur, tamil nadu, in
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago