Talent.com
Data Engineer
Data EngineerLanceSoft, Inc. • vapi, gujarat, in
No longer accepting applications
Data Engineer

Data Engineer

LanceSoft, Inc. • vapi, gujarat, in
15 days ago
Job description

Pay Rate : $11.00 / hr to $12.00 / hr

Location : 100% Remote working from India

Duration of contract : This is 4 to 4.5 months contract job

Working Hours : US working hours (Night Shift form india)

This team is looking to hire a motivated Sr. Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-art marketing data platform to solve various data-driven use cases across the organization. This marketing platform will host various data products such as but not limited to, Subscription, Content, and Product Analytics, Personalization and Recommendation, Marketing & Ad-Sales enablement. You will be working on flagship direct to consumer products such as MAX and Discovery Plus. You will be charged with building and maintaining various marketing focused data pipelines - handles both streaming and batch data processing. You will be helping data engineers, analysts, and scientists perform their functions by building highly scalable capabilities across the platform. This individual will bring in his / her expertise in a wide variety of big data processing frameworks (both open source and proprietary), large scale database systems (OLAP and OLTP), stream data processing, API Development, Machine learning operationalization, and cloud automation to build and support all the data needs.

The Daily

  • Design and develop the data platform to efficiently and cost effectively address various data needs across the business.
  • Build software across our entire cutting-edge data platform, including event driven and batch data processing, storage, and serving through various data integration techniques such as APIs, Lambda, File Feeds etc.
  • Develop and maintain data integrations includes but not limited to direct digital marketing, social channels etc.
  • Ingest, process massive campaign datasets to analyze the campaign performance.
  • Change how we think, act, and utilize our data by performing exploratory and quantitative analytics, data mining, and discovery.
  • Think of new ways to help make our data platform more scalable, resilient, and reliable and then work across our team to put your ideas into action.
  • Help us stay ahead of the curve by working closely with data architects, stream processing specialists, API developers, our DevOps team, and analysts to design systems which can scale elastically in ways which make other groups jealous
  • Work closely with data analysts and business stake holders to make data easily accessible and understandable to them.
  • Ensure data quality by implementing re-usable data quality frameworks.
  • Work closely with various other data engineering teams to roll out new capabilities.
  • Work closely with AI / ML team to operationalize and utilize models for business needs.
  • Develop and enforce data engineering, security, data quality standards through automation.
  • Participate in supporting the platform 24X7.
  • Be passionate about growing team - hire and mentor engineers and analysts.
  • Be responsible for cloud cost and improving efficiency.

The Essentials

  • Bachelor’s degree in computer science or similar discipline.
  • 8+ years of experience in software engineering
  • 5+ years of experience in data engineering.
  • Prior experience with Marketing is a plus
  • Go above and beyond attitude.
  • Ability to work in fast paced, high pressure, agile environment.
  • Ability and willingness to learn any new technologies and apply them at work to stay ahead of the curve.
  • Expertise in at least few programming languages - Java, Scala, Python or similar.
  • Expertise in building and managing large volume data processing (both streaming and batch) platform is a must.
  • Expertise in OLAP databases such as Snowflake or Redshift.
  • Expertise in SQL, Spark SQL, Hive etc.
  • Expertise in stream processing systems such as Kafka, Kinesis, Pulsar or Similar
  • Expertise in building micro services and managing containerized deployments, preferably using Kubernetes
  • Expertise in distributed data processing frameworks such as Apache Spark, Flink or Similar.
  • No-SQL (Apache Cassandra, DynamoDB or similar) is a huge plus
  • Experience in operationalizing and scaling machine models is a huge plus.
  • Experience with variety of data Tools & frameworks (example : Apache Airflow, Druid) will be a huge plus.
  • Experience with Analytics Tools such as Looker, Tableau is preferred.
  • Cloud (AWS) experience is preferred
  • Ability to learn and teach new languages and frameworks.
  • Excellent data analytical skills
  • Direct to consumer digital business experience preferred
  • Digital Advertising Tech experience will be a huge plus
  • Strong interpersonal, communication and presentation skills.
  • Strong team focus with outstanding organizational and resource management skills
  • Create a job alert for this search

    Data Engineer • vapi, gujarat, in

    Related jobs
    Data Engineer

    Data Engineer

    EXL • vapi, gujarat, in
    The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Ironbook AI • vapi, gujarat, in
    We are seeking an experienced and driven Lead Data Engineer to spearhead the.AI use cases across the organization.Minimum 7 years of experience in data engineering, with at.Strong hands-on experien...Show more
    Last updated: 4 hours ago • Promoted • New!
    Contract- Snowflake Data Engineer with Data Vault (Snowpark or CortexAI)

    Contract- Snowflake Data Engineer with Data Vault (Snowpark or CortexAI)

    KPG99 INC • vapi, gujarat, in
    Role Snowflake-focused Data Engineer.Location : Offshore Remote (India).Project involves implementing Data Vault 2.Work includes specific pipeline development in Snowflake with Streamlit.Not a tradi...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    ShimentoX Technologies • vapi, gujarat, in
    Data Engineer (Strong with Building data connectors).Key Skills : Python, Data Connectors, Metadata, API Integration-Rest / GraphQL. Must have proven background in building data connectors.Experience s...Show more
    Last updated: 1 day ago • Promoted
    Senior GenAI Engineer

    Senior GenAI Engineer

    Mitra AI • vapi, gujarat, in
    AI System Design & Development : .Architect, develop, and deploy large-scale Generative AI, LLM-based systems, including intelligent agents and automation workflows. LLM Integration & Optimization : .In...Show more
    Last updated: 14 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Ironbook AI • vapi, gujarat, in
    The ideal candidate will have strong experience with cloud platforms, modern ETL / ELT tools, and deep technical skills in Python, SQL, and distributed data frameworks. Design, develop, and maintain s...Show more
    Last updated: 4 hours ago • Promoted • New!
    Azure Data Engineer

    Azure Data Engineer

    Paritas Recruitment • vapi, gujarat, in
    Azure Data Engineer - 6 Month+ Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking an experienced and...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    MyRemoteTeam Inc • vapi, gujarat, in
    MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent.We empower businesses by providing world-class software engineers, operations suppo...Show more
    Last updated: 5 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Guidanz Inc • vapi, gujarat, in
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Meril • Vapi, Gujarat, India
    Experience Required : Minimum 1–2 Years.We are seeking a skilled and motivated Data Engineer to join our growing technology team. You’ll work with diverse data types and modern data platforms to desi...Show more
    Last updated: 28 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Confidential • vapi, gujarat, in
    Expertise in big data technologies such as Apache Spark and real-time streaming technologies like Apache Kafka.Strong programming skills in Python, Java, C++, SQL etc. Advanced knowledge of a major ...Show more
    Last updated: 5 hours ago • Promoted • New!
    Sr Azure Data Engineer - Remote work

    Sr Azure Data Engineer - Remote work

    techolution • vapi, gujarat, in
    Remote
    The ideal candidate will have a strong foundation in.Job Title : Azure Data Engineer.Work Timings : 5 : 00 PM to 2 : 00 AM IST. If your expertise is primarily in.Lead the migration of large-scale SQL work...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (Snowflake + Databricks)

    Data Engineer (Snowflake + Databricks)

    MyRemoteTeam Inc • vapi, gujarat, in
    MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent.We empower businesses by providing world-class software engineers, operations suppo...Show more
    Last updated: 4 hours ago • Promoted • New!
    Freelance Data Quality Engineer

    Freelance Data Quality Engineer

    Leading MNC • vapi, gujarat, in
    Freelance Data Quality Engineer.The candidate should have a minimum of 8+ yrs.If you're looking for freelance / part time opportunity (along with your day job) & a chance to work with the top 0.You ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer- ETL development

    Data Engineer- ETL development

    Globus Systems • vapi, gujarat, in
    Company : AA GLOBUSDIGITAL INDIA PRIVATE LIMITED.AA GLOBUSDIGITAL INDIA PRIVATE LIMITED, is a wholly owned subsidiary of Globus Systems Inc US,. Globus Systems was founded by industry executives who ...Show more
    Last updated: 17 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastra • vapi, gujarat, in
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
    Last updated: 17 days ago • Promoted
    AI Data Engineer

    AI Data Engineer

    Turing • vapi, gujarat, in
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 1 day ago • Promoted
    Azure DevOps Data Engineer

    Azure DevOps Data Engineer

    Paritas Recruitment • vapi, gujarat, in
    Azure DevOps (Data) Engineer - 6+ Month Rolling Contract.Remote - (Sunday to Thursday working days).Paritas is working with a global IT Consultancy & leading Energy client who are seeking a skilled...Show more
    Last updated: 1 day ago • Promoted