Talent.com
Data Engineer
Data EngineerLanceSoft, Inc. • Indore, India
No longer accepting applications
Data Engineer

Data Engineer

LanceSoft, Inc. • Indore, India
4 days ago
Job description

Pay Rate : $11.00 / hr to $12.00 / hr

Location : 100% Remote working from India

Duration of contract : This is 4 to 4.5 months contract job

Working Hours : US working hours (Night Shift form india)

This team is looking to hire a motivated Sr. Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve various data-driven use cases across the organization. This marketing platform will host various data products such as but not limited to, Subscription, Content, and Product Analytics, Personalization and Recommendation, Marketing & Ad-Sales enablement. You will be working on flagship direct to consumer products such as MAX and Discovery Plus. You will be charged with building and maintaining various marketing focused data pipelines - handles both streaming and batch data processing. You will be helping data engineers, analysts, and scientists perform their functions by building highly scalable capabilities across the platform. This individual will bring in his / her expertise in a wide variety of big data processing frameworks (both open source and proprietary), large scale database systems (OLAP and OLTP), stream data processing, API Development, Machine learning operationalization, and cloud automation to build and support all the data needs.

The Daily

  • Design and develop the data platform to efficiently and cost effectively address various data needs across the business.
  • Build software across our entire cutting-edge data platform, including event driven and batch data processing, storage, and serving through various data integration techniques such as APIs, Lambda, File Feeds etc.
  • Develop and maintain data integrations includes but not limited to direct digital marketing, social channels etc.
  • Ingest, process massive campaign datasets to analyze the campaign performance.
  • Change how we think, act, and utilize our data by performing exploratory and quantitative analytics, data mining, and discovery.
  • Think of new ways to help make our data platform more scalable, resilient, and reliable and then work across our team to put your ideas into action.
  • Help us stay ahead of the curve by working closely with data architects, stream processing specialists, API developers, our DevOps team, and analysts to design systems which can scale elastically in ways which make other groups jealous
  • Work closely with data analysts and business stake holders to make data easily accessible and understandable to them.
  • Ensure data quality by implementing re-usable data quality frameworks.
  • Work closely with various other data engineering teams to roll out new capabilities.
  • Work closely with AI / ML team to operationalize and utilize models for business needs.
  • Develop and enforce data engineering, security, data quality standards through automation.
  • Participate in supporting the platform 24X7.
  • Be passionate about growing team - hire and mentor engineers and analysts.
  • Be responsible for cloud cost and improving efficiency.

The Essentials

  • Bachelor’s degree in computer science or similar discipline.
  • 8+ years of experience in software engineering
  • 5+ years of experience in data engineering.
  • Prior experience with Marketing is a plus
  • Go above and beyond attitude.
  • Ability to work in fast paced, high pressure, agile environment.
  • Ability and willingness to learn any new technologies and apply them at work to stay ahead of the curve.
  • Expertise in at least few programming languages - Java, Scala, Python or similar.
  • Expertise in building and managing large volume data processing (both streaming and batch) platform is a must.
  • Expertise in OLAP databases such as Snowflake or Redshift.
  • Expertise in SQL, Spark SQL, Hive etc.
  • Expertise in stream processing systems such as Kafka, Kinesis, Pulsar or Similar
  • Expertise in building micro services and managing containerized deployments, preferably using Kubernetes
  • Expertise in distributed data processing frameworks such as Apache Spark, Flink or Similar.
  • No-SQL (Apache Cassandra, DynamoDB or similar) is a huge plus
  • Experience in operationalizing and scaling machine models is a huge plus.
  • Experience with variety of data Tools & frameworks (example : Apache Airflow, Druid) will be a huge plus.
  • Experience with Analytics Tools such as Looker, Tableau is preferred.
  • Cloud (AWS) experience is preferred
  • Ability to learn and teach new languages and frameworks.
  • Excellent data analytical skills
  • Direct to consumer digital business experience preferred
  • Digital Advertising Tech experience will be a huge plus
  • Strong interpersonal, communication and presentation skills.
  • Strong team focus with outstanding organizational and resource management skills
  • Create a job alert for this search

    Data Engineer • Indore, India

    Related jobs
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • indore, madhya pradesh, in
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer (Lead) ID42105

    Data Engineer (Lead) ID42105

    Confidential • Indore, India
    Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...Show more
    Last updated: 26 days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • indore, madhya pradesh, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer - ETL / Data Warehousing

    Data Engineer - ETL / Data Warehousing

    Hiringeye • Indore
    Modern, we're looking for a driven and detail-oriented Data Engineer with a strong consulting background to join our Client Technology Team. In this role, you will serve as a subject matter exp...Show more
    Last updated: 30+ days ago • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Confidential • Indore
    Assists with the data platform blueprint and design, encompassing the relevant data platform components.Collaborates with Integration Architects and Data Architects to ensure cohesive integration b...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Sikich India • Indore, Madhya Pradesh, India
    Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show more
    Last updated: 3 hours ago • Promoted • New!
    Azure Data Engineer

    Azure Data Engineer

    Tekfortune IT India Pvt Ltd • Indore
    Description : Title : Azure Data Engineer Experience : 8+ Years Work Location...Show more
    Last updated: 23 days ago • Promoted
    NucleusTeq - Data Engineer - BigQuery

    NucleusTeq - Data Engineer - BigQuery

    NucleusTeq Consulting Pvt. Ltd. • Indore
    Job Description : As a Data Engineer, you will work under the guidance of senior Data Engineers to design, develop, and maintain applications and data pipelines.You w...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Indore, Madhya Pradesh, India
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 7 hours ago • Promoted • New!
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turing • Indore, Madhya Pradesh, India
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer

    Data Engineer

    System Soft Technologies • Indore, Madhya Pradesh, India
    Title : Data Engineer Location : Remote (3–4-hour time zone overlaps with EST if off shore) Duration : 6 months Musts : Python NextFlow Plus : Computer Vision Image Processing Project Overview : Exper...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Confidential • Indore, India
    Professional & Technical Skills : .Must To Have Skills : Proficiency in Databricks Unified Data Analytics Platform.Good To Have Skills : Experience with Apache Spark and data warehousing solutions.Stro...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Epergne Solutions • Indore, Madhya Pradesh, India
    Quick Apply
    Job Roles & Responsibilities.Design, build, and optimize data pipelines and scalable data assets.Develop and maintain high-performance code using PySpark / Python with best practices.Perform code...Show more
    Last updated: 30+ days ago
    Data Engineer (DOMO & Python / Kafka)

    Data Engineer (DOMO & Python / Kafka)

    Smart Moves Consultants • Indore, Madhya Pradesh, India
    JD : We are looking for candidates with strong Domo and Python / Kafka connect experience.Please find the JD below and share suitable and strong profiles at the earliest. Mode of working : RemoteEngagem...Show more
    Last updated: 3 hours ago • Promoted • New!
    AWS – Data Engineer

    AWS – Data Engineer

    Epergne Solutions • Indore, Madhya Pradesh, India
    Quick Apply
    Pune / Hyderabad / Chennai / Mysuru / Bhubaneswar / Mangalore / Trivandrum / Chandigarh / Jaipur / Nagpur / Indore / Gurgaon. Job Roles & Responsibilities : -.Leverage AWS services (S3, EC2, Lambda, Redshift, CloudFor...Show more
    Last updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • indore, madhya pradesh, in
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 13 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Confidential • Indore
    Following are high level responsibilities that you will play but not limited to : .Lead the design, development, and implementation of modern data pipelines, data models, and ETL / ELT processes.Archit...Show more
    Last updated: 17 days ago • Promoted
    Data Engineer (Middle / Senior) ID42376

    Data Engineer (Middle / Senior) ID42376

    Confidential • Indore, India
    Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...Show more
    Last updated: 26 days ago • Promoted