Talent.com
Data Engineer
Data EngineerLanceSoft, Inc. • Gandhinagar, IN
Data Engineer

Data Engineer

LanceSoft, Inc. • Gandhinagar, IN
18 hours ago
Job description

Pay Rate : $11.00 / hr to $12.00 / hr

Location : 100% Remote

This team is looking to hire a motivated Sr. Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve various data-driven use cases across the organization. This marketing platform will host various data products such as but not limited to, Subscription, Content, and Product Analytics, Personalization and Recommendation, Marketing & Ad-Sales enablement. You will be working on flagship direct to consumer products such as MAX and Discovery Plus. You will be charged with building and maintaining various marketing focused data pipelines - handles both streaming and batch data processing. You will be helping data engineers, analysts, and scientists perform their functions by building highly scalable capabilities across the platform. This individual will bring in his / her expertise in a wide variety of big data processing frameworks (both open source and proprietary), large scale database systems (OLAP and OLTP), stream data processing, API Development, Machine learning operationalization, and cloud automation to build and support all the data needs across Warner Brothers Discovery platform.

The Daily

  • Design and develop the data platform to efficiently and cost effectively address various data needs across the business.
  • Build software across our entire cutting-edge data platform, including event driven and batch data processing, storage, and serving through various data integration techniques such as APIs, Lambda, File Feeds etc.
  • Develop and maintain data integrations includes but not limited to direct digital marketing, social channels etc.
  • Ingest, process massive campaign datasets to analyze the campaign performance.
  • Change how we think, act, and utilize our data by performing exploratory and quantitative analytics, data mining, and discovery.
  • Think of new ways to help make our data platform more scalable, resilient, and reliable and then work across our team to put your ideas into action.
  • Help us stay ahead of the curve by working closely with data architects, stream processing specialists, API developers, our DevOps team, and analysts to design systems which can scale elastically in ways which make other groups jealous
  • Work closely with data analysts and business stake holders to make data easily accessible and understandable to them.
  • Ensure data quality by implementing re-usable data quality frameworks.
  • Work closely with various other data engineering teams to roll out new capabilities.
  • Work closely with AI / ML team to operationalize and utilize models for business needs.
  • Develop and enforce data engineering, security, data quality standards through automation.
  • Participate in supporting the platform 24X7.
  • Be passionate about growing team - hire and mentor engineers and analysts.
  • Be responsible for cloud cost and improving efficiency.

The Essentials

  • Bachelor’s degree in computer science or similar discipline.
  • 8+ years of experience in software engineering
  • 5+ years of experience in data engineering.
  • Prior experience with Marketing is a plus
  • Go above and beyond attitude.
  • Ability to work in fast paced, high pressure, agile environment.
  • Ability and willingness to learn any new technologies and apply them at work to stay ahead of the curve.
  • Expertise in at least few programming languages - Java, Scala, Python or similar.
  • Expertise in building and managing large volume data processing (both streaming and batch) platform is a must.
  • Expertise in OLAP databases such as Snowflake or Redshift.
  • Expertise in SQL, Spark SQL, Hive etc.
  • Expertise in stream processing systems such as Kafka, Kinesis, Pulsar or Similar
  • Expertise in building micro services and managing containerized deployments, preferably using Kubernetes
  • Expertise in distributed data processing frameworks such as Apache Spark, Flink or Similar.
  • No-SQL (Apache Cassandra, DynamoDB or similar) is a huge plus
  • Experience in operationalizing and scaling machine models is a huge plus.
  • Experience with variety of data Tools & frameworks (example : Apache Airflow, Druid) will be a huge plus.
  • Experience with Analytics Tools such as Looker, Tableau is preferred.
  • Cloud (AWS) experience is preferred
  • Ability to learn and teach new languages and frameworks.
  • Excellent data analytical skills
  • Direct to consumer digital business experience preferred
  • Digital Advertising Tech experience will be a huge plus
  • Strong interpersonal, communication and presentation skills.
  • Strong team focus with outstanding organizational and resource management skills
  • Create a job alert for this search

    Data Engineer • Gandhinagar, IN

    Related jobs
    Data Engineer

    Data Engineer

    Recro • Ahmedabad, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Gandhinagar, IN
    Data Engineering & Azure ecosystem).We are looking for a passionate.This role involves working on ETL processes, data warehousing, and analytics solutions to enable high-quality insights for busine...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer JIS117883

    Data Engineer JIS117883

    Krayr Solutions • Gandhinagar, Gujarat, India
    Bachelor’s Degree in Computer Science, IT, or related field.Looker (LookML development & dashboards).Expertise in databases such as. Postgres, MongoDB, MySQL, BigQuery.Experience with visualization ...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Kanerika Inc • Ahmedabad, Gujarat, India
    Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge technologies in...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Gandhinagar, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastra • Gandhinagar, IN
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer (4 to 6 Years exp)

    Data Engineer (4 to 6 Years exp)

    DXFactor • Ahmedabad, Gujarat, India
    DXFactor is a US-based tech company working with customers across the globe.We are looking for candidates for.Data Engineer (4 to 6 Yrs exp). Designation : Data Engineer (Expertise in SnowFlake, AWS ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP Group • Ahmedabad, IN
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Analytix Business Solutions (India) Pvt. Ltd. • Ahmedabad, Gujarat, India
    Businesses of all sizes are faced with a rapidly changing competitive environment.Companies that possess both the ability to successfully navigate obstacles and the agility to react to market condi...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Gandhinagar, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    ProductSquads • Ahmedabad, Gujarat, India
    Company Profile : ProductSquads was founded with a bold mission : to engineer capital efficiency through autonomous AI agents, exceptional engineering, and real-time decision intelligence.We’re build...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Ahmedabad, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 16 days ago • Promoted
    Data Engineer

    Data Engineer

    Randstad Enterprise • Gandhinagar, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PamTen Inc • Gandhinagar, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
    Last updated: 8 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Advantmed • Ahmedabad, Gujarat, India
    Lead Data Engineer – Azure Cloud.We are looking for an experienced.The ideal candidate will design, develop, and maintain scalable data pipelines, ensure data quality, and leverage cloud technologi...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • Gandhinagar, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    BayOne Solutions • Ahmedabad, IN
    We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Ahmedabad, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 7 days ago • Promoted