Talent.com
This job offer is not available in your country.
Data Engineer II

Data Engineer II

ConfidentialMumbai, India
9 days ago
Job description

Data Engineer II

Location : Bangalore / Mumbai

About Media.net :

Media.net is a leading, global ad tech company that focuses on creating the most transparent and efficient path for advertiser budgets to become publisher revenue. Our proprietary contextual technology is at the forefront of enhancing Programmatic buying, the latest industry standard in ad buying for digital platforms.

The Media.net platform powers major global publishers and ad-tech businesses at scale across ad formats like display, video, mobile, native, as well as search. Media.net's U.S. HQ is based in New York, and the Global HQ is in Dubai. With office locations and consultant partners across the world, Media.net takes pride in the value-add it offers to its 50+ demand and 21K+ publisher partners, in terms of both products and services.

What does the team do

  • Every single web page view hits one or more services and hosts high scale service to handle this large volume of requests, across 5 million unique topics.
  • Some of the platforms built and managed by the team.
  • To achieve this we use cutting edge Machine Learning and AI technologies on a large Hadoop cluster.
  • Tech Stack – Java, Elastic Search / Solr, Kafka, Spark, Machine Learning, NLP, Deep Learning, Redis, Big Data technologies like Hadoop, HBase, YARN etc.

Roles and Responsibilities :

  • Design, execution and management of a large and complex distributed data systems.
  • Monitoring of performance and optimizing existing projects.
  • Researching on and integrating any Big Data tools and frameworks required to provide requested capabilities.
  • Understanding Business / Data requirements and implementing scalable solutions.
  • Creating reusable components and data tools which help all the teams in the company to integrate with our data platform.
  • Who should apply for this role

  • 2 to 4 years of experience in big data technologies (Apache Hadoop) and relational databases (ms sql server / oracle / MySQL / postgres).
  • Proficiency in at least one of the following programming languages - Java, Python or Scala.
  • Expertise in SQL (T-SQL / PL-SQL / SPARK-SQL / HIVE-QL).
  • Proficiency in Apache Spark. Hands on knowledge of working with Data Frames, Data Sets, RDDs, Spark SQL / PySpark / Scala APIs with deep understanding of Performance Optimizations.
  • Good Understanding of Distributed Storage (HDFS / S3).
  • Strong analytical / quantitative skills and comfortable working with very large sets of data.
  • Experience with integration of data across multiple data sources.
  • Good understanding of distributed computing principles.
  • Good to have skills :

  • Experience with Message Queues (e.g., Apache Kafka).
  • Experience with MPP systems (e.g., Redshift / Snowflake).
  • Experience with NoSQL storage (e.g., MongoDB).
  • Show more

    Show less

    Skills Required

    Spark SQL, Java, Apache Hadoop, S3, T-sql, Pyspark, Scala, Apache Spark, hdfs , Redshift, Sql, snowflake , Pl-sql, Apache Kafka, Mongodb, Python

    Create a job alert for this search

    Data Engineer Ii • Mumbai, India

    Related jobs
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsKalyan-Dombivli, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    Media.netMumbai, Maharashtra, India
    Our proprietary contextual technology is at the forefront of enhancing Programmatic buying, the latest industry standard in ad buying for digital platforms. HQ is based in New York, and the Global H...Show moreLast updated: 20 days ago
    • Promoted
    AWS Certified Data Engineer

    AWS Certified Data Engineer

    CodeVyasaMumbai, India
    Looking for AWS Certified Data Engineer| Mumbai to join a team of rockstar developers.The candidate should have a minimum of 4+ yrs. About CodeVyasa : CodeVyasa is a mid-sized product engineering...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Kline + CompanyMumbai, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 11 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesKalyan-Dombivli, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalthane, maharashtra, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsKalyan-Dombivli, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaThane, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Envuthane, maharashtra, in
    At Envu, we partner with our customers to design world-class, forward-thinking innovations that protect and enhance the health of environments around the world. We offer dedicated services in : Profe...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incmumbai, maharashtra, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 19 days ago
    • Promoted
    Engineer

    Engineer

    Alp Consulting Ltd.dombivli, maharashtra, in
    As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data processing systems on. You will collaborate with cross-functional teams to ensure data is acces...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Kalyan-Dombivli, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeThane, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIMumbai, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalKalyan-Dombivli, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekKalyan-Dombivli, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 17 days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    World Wide Technologymumbai, maharashtra, in
    World Wide Technology Holding Co, LLC (WWT).Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome. Louis, WWT works closely with industry leaders su...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Datamatics Business SolutionsMumbai, Maharashtra, India
    We are seeking a skilled and motivated Data Engineer to join our team.The ideal candidate will be responsible for designing, implementing, and maintaining our data infrastructure to support our B2B...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicesnavi mumbai, maharashtra, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseMumbai, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 6 days ago