Talent.com
This job offer is not available in your country.
Data Engineer - Spark / SQL

Data Engineer - Spark / SQL

Shree HR Consultancy ServicesBangalore
5 days ago
Job description

Job Description

We are seeking a skilled Ops Data Engineer to maintain robust data infrastructure and pipelines that support our operational analytics and business intelligence needs.

Candidates will bridge the gap between data engineering and operations, ensuring reliable, scalable, and efficient data systems that enable data-driven decision making across the organization.

Primary Skills :

  • Strong proficiency in Spark SQL
  • Hands-on experience with Apache Kafka, Apache Flink, and other relevant streaming technologies
  • Databases : Strong knowledge of relational databases (Oracle, MySQL) and NoSQL systems
  • Proficiency with Version Control Git, CI / CD practices and collaborative development workflows
  • Good understanding of orchestrating complex computational workflows and data processing pipelines - UC4, Apache Airflow or equivalent.
  • Agile development to have :
  • Proficiency in programming language
  • Python / Java or equivalent

Key Responsibilities :

  • Design, develop, and maintain data pipelines and infrastructure to support operational analytics and BI needs
  • Implement and optimize streaming data processing using technologies like Apache Kafka and Apache Flink
  • Develop and maintain complex SQL queries and data transformations using Spark SQL
  • Manage and optimize data storage across relational databases (Oracle, MySQL) and NoSQL systems
  • Utilize version control systems like Git, and apply CI / CD best practices for deployment and collaboration
  • Orchestrate and automate complex workflows and data processing pipelines using tools such as UC4, Apache Airflow, or Collaborate with cross-functional teams in an Agile development environment to deliver high-quality data solutions
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Bangalore

    Related jobs
    • Promoted
    • New!
    Data Engineer - (Spark, Scala, Python, Cassandra, Elasticsearch, AWS, Airflow, SQL)

    Data Engineer - (Spark, Scala, Python, Cassandra, Elasticsearch, AWS, Airflow, SQL)

    The Nielsen Companybangalore, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

    Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

    The Nielsen Companybangalore, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    Software Engineer - Java / Scala, Spark, SQL, AWS, Python

    The Nielsen Companybangalore, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Data Engineer PL / SQL

    Data Engineer PL / SQL

    XIMAX SOLUTIONSbangalore, India
    We are scouting for Data Engineers with 3 to 8Yrs experience.Data Engineers working with Oracle PLSQL.They ensure data integrity, performance, and security while collaborating with other teams to m...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer (Spark Scala)

    Data Engineer (Spark Scala)

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Greetings from TATA Consultancy Services.Location- Chennai / Pune / Bangalore / Hyderabad / Delhi.Pls find the Job Description below. Big Data Hadoop - Hive and Spark / Scala solid experience.SQL advance kn...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    Senior Data Engineer - (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda)

    Senior Data Engineer - (Spark, Presto, Pandas, RDS, EC2, S3, Athena, Lambda)

    The Nielsen Companybangalore, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    TechVeritobangalore district, karnataka, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    ScaleneWorksbangalore, India
    Big Data engineer having extensive coding experience in Spark & Scala.He / She should be able to work well within a product-based organization (product mindset) and with a team comprising of develope...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Big Data Engineer ( Java / Scala and SQL)

    Big Data Engineer ( Java / Scala and SQL)

    The Nielsen Companybangalore, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 14 hours ago
    • Promoted
    5+ YoE - Data Engineer – PySpark / Spark Scala with Cloud & SQL - Immediate Joiner - Bengaluru

    5+ YoE - Data Engineer – PySpark / Spark Scala with Cloud & SQL - Immediate Joiner - Bengaluru

    USTBengaluru, Karnataka, India
    CCTC | ECTC | Notice Period | Location Preference.Act fast for immediate attention! ⏳📩.Design, develop, and maintain scalable data pipelines using Spark (PySpark or Spark with Scala.Build data ing...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    SynechronBangalore Urban, Karnataka, India
    We have immediate opportunity for.Data Engineer (Python, Spark / Scala).Data Engineer (Python, Spark / Scala).Notice Period : Immediate joiner only. At Synechron, we believe in the power of digital to tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIBengaluru, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (SQL ADF)

    Data Engineer (SQL ADF)

    Talent Corner HR Services Pvt LtdBengaluru, Karnataka, India
    Must Have : SQL Development, Azure Data Factory, ETL Processes.The Ideal candidate will have a.SQL, experience with ETL processes, and a deep understanding of data modelling and database performance...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Big Data Spark

    Big Data Spark

    Anicalls (Pty) Ltdbangalore, India
    Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform.Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HB...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    AWS Big data pyspark SQL Spark Airflow

    AWS Big data pyspark SQL Spark Airflow

    ScaleneWorksbangalore, India
    Job Title : AWS Big Data Engineer.We are looking for a highly skilled AWS Big Data Engineer with extensive experience in PySpark, SQL, Spark, and Airflow. The ideal candidate will have a strong backg...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Sr. Data Engineer (Python, Spark, Hadoop, Hive, 4-7 years' experience)

    Sr. Data Engineer (Python, Spark, Hadoop, Hive, 4-7 years' experience)

    Visabangalore, India
    Visa is seeking highly energetic, passionate, technology enthusiast for Data Engineering team.The successful candidate will work as a Senior Data Engineer and be part of the Risk Solution Services ...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL DigitalBengaluru, Karnataka, India
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIBangalore, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 19 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data Solutionshosur, tamil nadu, in
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago