Talent.com
This job offer is not available in your country.
Data Engineer II

Data Engineer II

Media.netMumbai, Maharashtra, India
17 days ago
Job description

Data Engineer II

Location : Bangalore / Mumbai

About Media.net :

Media.net is a leading, global ad tech company that focuses on creating the most transparent and efficient path for advertiser budgets to become publisher revenue. Our proprietary contextual technology is at the forefront of enhancing Programmatic buying, the latest industry standard in ad buying for digital platforms.

The Media.net platform powers major global publishers and ad-tech businesses at scale across ad formats like display, video, mobile, native, as well as search. Media.net’s U.S. HQ is based in New York, and the Global HQ is in Dubai. With office locations and consultant partners across the world, Media.net takes pride in the value-add it offers to its 50+ demand and 21K+ publisher partners, in terms of both products and services.

What does the team do?

  • Every single web page view hits one or more services and hosts high scale service to handle this large volume of requests, across 5 million unique topics.
  • Some of the platforms built and managed by the team.
  • To achieve this we use cutting edge Machine Learning and AI technologies on a large Hadoop cluster.
  • Tech Stack – Java, Elastic Search / Solr, Kafka, Spark, Machine Learning, NLP, Deep Learning, Redis, Big Data technologies like Hadoop, HBase, YARN etc.

Roles and Responsibilities :

  • Design, execution and management of a large and complex distributed data systems.
  • Monitoring of performance and optimizing existing projects.
  • Researching on and integrating any Big Data tools and frameworks required to provide requested capabilities.
  • Understanding Business / Data requirements and implementing scalable solutions.
  • Creating reusable components and data tools which help all the teams in the company to integrate with our data platform.
  • Who should apply for this role?

  • 2 to 4 years of experience in big data technologies (Apache Hadoop) and relational databases (ms sql server / oracle / MySQL / postgres).
  • Proficiency in at least one of the following programming languages - Java, Python or Scala.
  • Expertise in SQL (T-SQL / PL-SQL / SPARK-SQL / HIVE-QL).
  • Proficiency in Apache Spark. Hands on knowledge of working with Data Frames, Data Sets, RDDs, Spark SQL / PySpark / Scala APIs with deep understanding of Performance Optimizations.
  • Good Understanding of Distributed Storage (HDFS / S3).
  • Strong analytical / quantitative skills and comfortable working with very large sets of data.
  • Experience with integration of data across multiple data sources.
  • Good understanding of distributed computing principles.
  • Good to have skills :

  • Experience with Message Queues (e.g., Apache Kafka).
  • Experience with MPP systems (e.g., Redshift / Snowflake).
  • Experience with NoSQL storage (e.g., MongoDB).
  • Create a job alert for this search

    Data Engineer Ii • Mumbai, Maharashtra, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Thane, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 23 days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    World Wide TechnologyMumbai, Maharashtra, India
    World Wide Technology Holding Co, LLC (WWT).Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome. Louis, WWT works closely with industry leaders su...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    Media.netmumbai, maharashtra, in
    Our proprietary contextual technology is at the forefront of enhancing Programmatic buying, the latest industry standard in ad buying for digital platforms. HQ is based in New York, and the Global H...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubesthane, maharashtra, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIThane, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Datamatics Business Solutionsmumbai, maharashtra, in
    We are seeking a skilled and motivated Data Engineer to join our team.The ideal candidate will be responsible for designing, implementing, and maintaining our data infrastructure to support our B2B...Show moreLast updated: 4 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data Solutionsmumbai city, maharashtra, in
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incmumbai, maharashtra, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Xebiadombivli, maharashtra, in
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsThane, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicesdombivli, maharashtra, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 2 days ago
    • Promoted
    Rocket UniData Engineer

    Rocket UniData Engineer

    Mitra AIthane, maharashtra, in
    The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Everisethane, maharashtra, in
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    ConfidentialMumbai, India
    Our proprietary contextual technology is at the forefront of enhancing Programmatic buying, the latest industry standard in ad buying for digital platforms. HQ is based in New York, and the Global H...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalThane, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekKalyan-Dombivli, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 15 days ago
    • Promoted
    AI Engineer

    AI Engineer

    GumoThane, IN
    Design, build, and maintain our AI-driven knowledge graph creation pipeline.Integrate third-party APIs for web scraping (e. Tavily), and multimedia processing.Develop and refine sophisticated prompt...Show moreLast updated: 2 days ago
    • Promoted
    AWS Certified Data Engineer

    AWS Certified Data Engineer

    CodeVyasamumbai, maharashtra, in
    AWS Certified Data Engineer| Mumbai.The candidate should have a minimum of.CodeVyasa is a mid-sized product engineering company that works with top-tier product / solutions companies such as McKinsey...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgenavi mumbai, maharashtra, in
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalmumbai city, maharashtra, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago