Talent.com
Senior Data Engineer - SQL / Python

Senior Data Engineer - SQL / Python

QUARKS TECHNOSOFT PRIVATE LIMITEDBangalore
24 days ago
Job description

Job Description :

We are looking for a Senior Data Engineer with 6+ years of hands-on experience in designing and building scalable, cloud-native data solutions. This role is ideal for someone who is passionate about data architecture, enjoys solving complex data problems, and thrives in fast-paced, collaborative environments. The ideal candidate should have strong experience with Google Cloud Platform (GCP) services and modern data engineering practices.

As a Senior Data Engineer, you will be responsible for developing and maintaining data pipelines that support analytics, machine learning, and business intelligence use cases. Youll collaborate closely with cross-functional teams including business analysts, product owners, BI developers, and data scientists to build reliable and scalable data products.

Key Responsibilities :

  • Work with tools such as BigQuery, Dataflow, Composer (Airflow), Pub / Sub, Cloud Storage, Vertex AI, and more.
  • Implement medallion architecture, star schema, and other modern data modeling techniques to optimize data flow and querying.
  • Ensure data quality, integrity, scalability, and security across all pipelines and data platforms.
  • Collaborate with analytics and data science teams to deliver actionable and timely data products.
  • Follow best practices in CI / CD, test automation, and pipeline monitoring to ensure smooth and reliable deployments.
  • Ingest data via APIs and other streaming / batch sources, ensuring efficient integration with enterprise systems.
  • Stay up-to-date with the latest trends in data engineering, cloud infrastructure, and DevOps practices.

Required Skills & Qualifications :

  • 6+ years of experience in data engineering, with a focus on large-scale and cloud-native data systems.
  • Strong expertise in Google Cloud Platform, especially : BigQuery, Composer (Airflow), Dataflow, Pub / Sub, Cloud Storage, Vertex AI (nice to have)
  • Proficient in SQL and Python, with experience in building ETL / ELT processes.
  • Deep understanding of data warehousing concepts, data modeling, and orchestration frameworks.
  • Experience with CI / CD pipelines, automated testing, and monitoring for data pipelines.
  • Familiarity with machine learning engineering concepts is a plus.
  • Strong problem-solving skills and ability to communicate technical ideas clearly.
  • (ref : hirist.tech)

    Create a job alert for this search

    Senior Data Engineer • Bangalore

    Related jobs
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360hosur, tamil nadu, in
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ImpetusBengaluru, Karnataka, India
    Open Location - Indore, Noida, Gurgaon, Bangalore, Hyderabad, Pune Immediate Joiners are preferred.Qualification - 4 years of good hands-on exposure with Big Data technologies – pySpark (Data fra...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Contract Role - 6 months to 1 year - Senior Data Engineer - Python, AWS, Building Data Pipelines

    Contract Role - 6 months to 1 year - Senior Data Engineer - Python, AWS, Building Data Pipelines

    CareerXperts Consultinghosur, tamil nadu, in
    Our client is looking for a talented experienced software development consultants, specializing in Agile Delivery.A place where you are a polyglot, working alongside the client,.A world where you a...Show moreLast updated: 4 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticshosur, tamil nadu, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Manuh TechnologiesBengaluru, IN
    Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability. Troubleshoot and resolve data-relat...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail AnalyticsBengaluru, Karnataka, India
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer

    Software Engineer

    CoforgeGreater Bengaluru Area, India
    Location : Greater Noida & Bangalore.Expert Knowledge of C++ development in Linux environment with 3+ years of development experience. In-depth Knowledge of Object-Oriented Programming and Design Pa...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladehosur, tamil nadu, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 21 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Coffeee.ioBangalore, IN
    Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 3 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AvathonBengaluru, Karnataka, India
    AI with a powerful platform that enables businesses to harness the full potential of their operational data.Our technology seamlessly integrates and contextualizes siloed datasets, providing a 360-...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer - Bangalore

    Senior Data Engineer - Bangalore

    BenchireBengaluru, Karnataka, India
    Hi, We are Hiring for a Senior data Engineer with 6-8 years of Experience for a IT Services company based in Bangalore.Min 6-8 years of professional experience. Minimum of three years of professiona...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIBengaluru, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labshosur, tamil nadu, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 20 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Sonata SoftwareBengaluru, Karnataka, India
    Experience building data pipelines.Highly proficient in python, Data frames.Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB. Highly proficient in SQL Query.Snowflake or experi...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyhosur, tamil nadu, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 21 days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Sympera AIhosur, tamil nadu, in
    Join a well-funded fintech startup, led by a successful serial fintech entrepreneur.We aim to revolutionize f inancial services with our advanced LLM-based platform. This is a unique opportunity to ...Show moreLast updated: 3 days ago
    • Promoted
    Software Engineer

    Software Engineer

    Alp Consulting Ltd.Bangalore Rural, Karnataka, India
    Years of in Big Data & Data related technology experience.Expert level understanding of distributed computing principles. Expert level knowledge and experience in Apache Spark.Hands on programming w...Show moreLast updated: 2 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDhosur, tamil nadu, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Az-Tec Talenthosur, tamil nadu, in
    Remote
    Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 19 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Nityo Infotechhosur, tamil nadu, in
    Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes.Minimum 5 years of experience in Data Engineering or Infrastructure roles. Proven hands-on experience with Apache Spark ...Show moreLast updated: 4 hours ago