Talent.com
This job offer is not available in your country.
Data Engineer - Big Data Technologies

Data Engineer - Big Data Technologies

HyreSnapMumbai
30+ days ago
Job description

Job Description : Responsibilities :

  • Design, execution, and management of a large and complex distributed data system.
  • Monitoring of performance and optimizing existing projects.
  • Researching and integrating any Big Data tools and frameworks required to provide the requested capabilities.
  • Understanding Business / Data requirements and implementing scalable solutions.
  • Creating reusable components and data tools that help all the teams in the company to integrate with our data platform.

Requirements :

  • 1- 4 years of experience in big data technologies (Apache Hadoop) and relational databases (MS SQL Proficiency in at least one of the following programming languages : Java, Python, or Scala.
  • Expertise in SQL Proficiency in Apache Spark.
  • Hands-on knowledge of working with Data Frames, Data Sets, RDDs, Spark SQL / PySpark / Scala APIs, with a deep understanding of Performance Optimizations.
  • Good Understanding of Distributed Storage (HDFS / S3).
  • Strong analytical / quantitative skills and comfortable working with very large sets of data.
  • Experience with the integration of data across multiple data sources.
  • Good understanding of distributed computing principles.
  • It would be good if you have the following skills :

  • Experience with Message Queues (e. g., Apache Kafka).
  • Experience with MPP systems (e. g., Redshift / Snowflake).
  • Experience with NoSQL storage (e. g., MongoDB).
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Engineer • Mumbai

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Thane, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 23 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsKalyan-Dombivli, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    FornaxMumbai, Maharashtra, India
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgeMumbai, IN
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekMumbai, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubesdombivli, maharashtra, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incmumbai city, maharashtra, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Envuthane, maharashtra, in
    At Envu, we partner with our customers to design world-class, forward-thinking innovations that protect and enhance the health of environments around the world. We offer dedicated services in : Profe...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainKalyan-Dombivli, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsThane, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    SolarSquareMumbai, Maharashtra, India
    Job Description : Data Engineer.As a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure.Your work will transform raw, messy data into clean,. You’ll collaborate cross-fun...Show moreLast updated: 13 hours ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticsthane, maharashtra, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    FornaxMumbai, Maharashtra, India
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Datamatics Business SolutionsMumbai, Maharashtra, India
    We are seeking a skilled and motivated Data Engineer to join our team.The ideal candidate will be responsible for designing, implementing, and maintaining our data infrastructure to support our B2B...Show moreLast updated: 3 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisThane, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseThane, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESMumbai, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionMumbai, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeKalyan-Dombivli, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitaldombivli, maharashtra, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago