Talent.com
Data Engineer

Data Engineer

LanceSoft, Inc.vapi, gujarat, in
10 hours ago
Job description

Pay Rate : $11.00 / hr to $12.00 / hr

Location : 100% Remote

This team is looking to hire a motivated Sr. Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve various data-driven use cases across the organization. This marketing platform will host various data products such as but not limited to, Subscription, Content, and Product Analytics, Personalization and Recommendation, Marketing & Ad-Sales enablement. You will be working on flagship direct to consumer products such as MAX and Discovery Plus. You will be charged with building and maintaining various marketing focused data pipelines - handles both streaming and batch data processing. You will be helping data engineers, analysts, and scientists perform their functions by building highly scalable capabilities across the platform. This individual will bring in his / her expertise in a wide variety of big data processing frameworks (both open source and proprietary), large scale database systems (OLAP and OLTP), stream data processing, API Development, Machine learning operationalization, and cloud automation to build and support all the data needs across Warner Brothers Discovery platform.

The Daily

  • Design and develop the data platform to efficiently and cost effectively address various data needs across the business.
  • Build software across our entire cutting-edge data platform, including event driven and batch data processing, storage, and serving through various data integration techniques such as APIs, Lambda, File Feeds etc.
  • Develop and maintain data integrations includes but not limited to direct digital marketing, social channels etc.
  • Ingest, process massive campaign datasets to analyze the campaign performance.
  • Change how we think, act, and utilize our data by performing exploratory and quantitative analytics, data mining, and discovery.
  • Think of new ways to help make our data platform more scalable, resilient, and reliable and then work across our team to put your ideas into action.
  • Help us stay ahead of the curve by working closely with data architects, stream processing specialists, API developers, our DevOps team, and analysts to design systems which can scale elastically in ways which make other groups jealous
  • Work closely with data analysts and business stake holders to make data easily accessible and understandable to them.
  • Ensure data quality by implementing re-usable data quality frameworks.
  • Work closely with various other data engineering teams to roll out new capabilities.
  • Work closely with AI / ML team to operationalize and utilize models for business needs.
  • Develop and enforce data engineering, security, data quality standards through automation.
  • Participate in supporting the platform 24X7.
  • Be passionate about growing team - hire and mentor engineers and analysts.
  • Be responsible for cloud cost and improving efficiency.

The Essentials

  • Bachelor’s degree in computer science or similar discipline.
  • 8+ years of experience in software engineering
  • 5+ years of experience in data engineering.
  • Prior experience with Marketing is a plus
  • Go above and beyond attitude.
  • Ability to work in fast paced, high pressure, agile environment.
  • Ability and willingness to learn any new technologies and apply them at work to stay ahead of the curve.
  • Expertise in at least few programming languages - Java, Scala, Python or similar.
  • Expertise in building and managing large volume data processing (both streaming and batch) platform is a must.
  • Expertise in OLAP databases such as Snowflake or Redshift.
  • Expertise in SQL, Spark SQL, Hive etc.
  • Expertise in stream processing systems such as Kafka, Kinesis, Pulsar or Similar
  • Expertise in building micro services and managing containerized deployments, preferably using Kubernetes
  • Expertise in distributed data processing frameworks such as Apache Spark, Flink or Similar.
  • No-SQL (Apache Cassandra, DynamoDB or similar) is a huge plus
  • Experience in operationalizing and scaling machine models is a huge plus.
  • Experience with variety of data Tools & frameworks (example : Apache Airflow, Druid) will be a huge plus.
  • Experience with Analytics Tools such as Looker, Tableau is preferred.
  • Cloud (AWS) experience is preferred
  • Ability to learn and teach new languages and frameworks.
  • Excellent data analytical skills
  • Direct to consumer digital business experience preferred
  • Digital Advertising Tech experience will be a huge plus
  • Strong interpersonal, communication and presentation skills.
  • Strong team focus with outstanding organizational and resource management skills
  • Create a job alert for this search

    Data Engineer • vapi, gujarat, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyativapi, gujarat, in
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Engineer with Databricks & GCP

    Data Engineer with Databricks & GCP

    iitjobs, Inc.vapi, gujarat, in
    Role : - Data Engineer with Databricks & GCP.Extensive hands-on experience with Databricks (Autoloader, DLT, Delta Lake, CDF) and PySpark. Expertise in SQL and advanced query optimization.Proficiency ...Show moreLast updated: 10 hours ago
    • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Incvapi, gujarat, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 15 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpressvapi, gujarat, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 15 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesvapi, gujarat, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 24 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    SystemBendervapi, gujarat, in
    Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show moreLast updated: 9 days ago
    • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turingvapi, gujarat, in
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Servicesvapi, gujarat, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    AI Data Engineer

    AI Data Engineer

    Peak Trust Global Real Estatevapi, gujarat, in
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show moreLast updated: 2 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Servicesvapi, gujarat, in
    TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services). Strong expertise in Azure Data Engineering & ETL Co...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    MerilVapi, Gujarat, India
    Experience Required : Minimum 1–2 Years.We are seeking a skilled and motivated Data Engineer to join our growing technology team. You’ll work with diverse data types and modern data platforms to desi...Show moreLast updated: 13 days ago
    • Promoted
    • New!
    Palantir Data Engineer

    Palantir Data Engineer

    SageBeans RPOvapi, gujarat, in
    Location : Remote work in India.Experience and skills required for the Palantir Forward Deployed Engineer, Palantir FDE.Python, SQL and optionally Java / Scala. Code repositories, Pipeline Builder, Cod...Show moreLast updated: 10 hours ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limitedvapi, gujarat, in
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 1 day ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careersvapi, gujarat, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    BayOne Solutionsvapi, gujarat, in
    We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    Tech Mahindravapi, gujarat, in
    Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    WhiteLotus Talent Partnersvapi, gujarat, in
    Job Title- Azure Data Engineer Pyspark.Location- Whitefield / Domlur Embassy Park , Bangalore.Minimum 5 years of PySpark Development experience, especially in Spark SQL and Complex Transformations....Show moreLast updated: 10 hours ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastravapi, gujarat, in
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 2 days ago