Talent.com
This job offer is not available in your country.
Data Engineer II

Data Engineer II

Media.netmumbai, maharashtra, in
19 days ago
Job description

Data Engineer II

Location : Bangalore / Mumbai

About Media.net :

Media.net is a leading, global ad tech company that focuses on creating the most transparent and efficient path for advertiser budgets to become publisher revenue. Our proprietary contextual technology is at the forefront of enhancing Programmatic buying, the latest industry standard in ad buying for digital platforms.

The Media.net platform powers major global publishers and ad-tech businesses at scale across ad formats like display, video, mobile, native, as well as search. Media.net’s U.S. HQ is based in New York, and the Global HQ is in Dubai. With office locations and consultant partners across the world, Media.net takes pride in the value-add it offers to its 50+ demand and 21K+ publisher partners, in terms of both products and services.

What does the team do?

  • Every single web page view hits one or more services and hosts high scale service to handle this large volume of requests, across 5 million unique topics.
  • Some of the platforms built and managed by the team.
  • To achieve this we use cutting edge Machine Learning and AI technologies on a large Hadoop cluster.
  • Tech Stack – Java, Elastic Search / Solr, Kafka, Spark, Machine Learning, NLP, Deep Learning, Redis, Big Data technologies like Hadoop, HBase, YARN etc.

Roles and Responsibilities :

  • Design, execution and management of a large and complex distributed data systems.
  • Monitoring of performance and optimizing existing projects.
  • Researching on and integrating any Big Data tools and frameworks required to provide requested capabilities.
  • Understanding Business / Data requirements and implementing scalable solutions.
  • Creating reusable components and data tools which help all the teams in the company to integrate with our data platform.
  • Who should apply for this role?

  • 2 to 4 years of experience in big data technologies (Apache Hadoop) and relational databases (ms sql server / oracle / MySQL / postgres).
  • Proficiency in at least one of the following programming languages - Java, Python or Scala.
  • Expertise in SQL (T-SQL / PL-SQL / SPARK-SQL / HIVE-QL).
  • Proficiency in Apache Spark. Hands on knowledge of working with Data Frames, Data Sets, RDDs, Spark SQL / PySpark / Scala APIs with deep understanding of Performance Optimizations.
  • Good Understanding of Distributed Storage (HDFS / S3).
  • Strong analytical / quantitative skills and comfortable working with very large sets of data.
  • Experience with integration of data across multiple data sources.
  • Good understanding of distributed computing principles.
  • Good to have skills :

  • Experience with Message Queues (e.g., Apache Kafka).
  • Experience with MPP systems (e.g., Redshift / Snowflake).
  • Experience with NoSQL storage (e.g., MongoDB).
  • Create a job alert for this search

    Data Engineer Ii • mumbai, maharashtra, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIKalyan-Dombivli, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Engineer

    Engineer

    Alp Consulting Ltd.thane, maharashtra, in
    As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data processing systems on. You will collaborate with cross-functional teams to ensure data is acces...Show moreLast updated: 17 days ago
    • Promoted
    AI Engineer

    AI Engineer

    GumoKalyan-Dombivli, IN
    Design, build, and maintain our AI-driven knowledge graph creation pipeline.Integrate third-party APIs for web scraping (e. Tavily), and multimedia processing.Develop and refine sophisticated prompt...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekThane, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalthane, maharashtra, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicesthane, maharashtra, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaThane, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Datamatics Business Solutionsmumbai, maharashtra, in
    We are seeking a skilled and motivated Data Engineer to join our team.The ideal candidate will be responsible for designing, implementing, and maintaining our data infrastructure to support our B2B...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Envuthane, maharashtra, in
    At Envu, we partner with our customers to design world-class, forward-thinking innovations that protect and enhance the health of environments around the world. We offer dedicated services in : Profe...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incmumbai city, maharashtra, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsThane, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Fornaxmumbai, maharashtra, in
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 4 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsThane, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeThane, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalThane, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    World Wide Technologymumbai, maharashtra, in
    World Wide Technology Holding Co, LLC (WWT).Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome. Louis, WWT works closely with industry leaders su...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Mumbai, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseThane, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 5 days ago