Talent.com
Senior Data Engineer

Senior Data Engineer

Poshmarktamil nadu, tamil nadu, in
3 days ago
Job description

Job Description :

Senior Software Engineer - Data Engineering

Big Data team is a central player in the Poshmark organization. Our mission is to

build a world-class big data platform to bring value out of data for us and for our customers. Our goal is to democratize data, support exploding business, build data and ML pipelines to fuel existing and new business critical initiatives.

The Data Engineering team at Poshmark is looking for an experienced software engineer to take care of Poshmak’s growth data, ensuring real-time access to quality data for all the stakeholders. The role requires strong understanding of software engineering best practices and excellent software development skills to build and maintain real-time and batch data pipelines with a focus on scalability and optimizations. In addition, the role also requires collaborating with Data Science, Analytics and other Engineering teams to build newer ETLs analyzing terabytes of data.

The role also requires being able to write clean and scalable code to pull datasets from disparate sources involving External APIs, S3 transfers, Kafka, Demux and so on. You will work with cutting edge technologies and frameworks like Scala, Ruby, Apache Spark, Airflow, Redshift, Databricks, Docker etc. You will also manage the growth data infrastructure comprising ETL pipelines, Hive tables, Redshift tables, BI tools. We are looking for a software engineer who can help us define the next phase of growth data systems in terms of scalability and stability.

Responsibilities

  • Design, Develop & Maintain growth data pipelines and integrate paid media sources like Facebook and Google to drive insights for business.
  • Build highly scalable, available, fault-tolerant data processing systems using AWS technologies, Kafka, Spark, and other big data technologies. These systems should handle batch and real-time data processing over 100s of terabytes of data ingested every day and a petabyte-sized data warehouse.
  • Responsible for architecting / designing / developing critical data pipelines at Poshmark.
  • Maintain and support existing platforms and evolve to newer technology stacks and architectures.
  • Participate and contribute to constantly improving best practices in development.

Desired Skills

  • 3+ years of overall software development experience.
  • Strong software development experience with Big Data technologies and hands-on coding experience.
  • Expertise in architecting and building large-scale data processing systems using Big Data technologies like Spark, Hadoop, EMR, Kafka / Kinesis, Flink, Druid.
  • Able to deliver complex projects end-to-end.
  • Expertise in SQL with knowledge on any existing data warehouse technology like Redshift.
  • Be self-driven, take complete ownership of initiatives, make pragmatic technical decisions and collaborate with cross-functional teams.
  • Excellent communication skills and ability to work cross functionally.
  • Expertise in Google Apps Script, Databricks or API Integrations is a plus.
  • Technologies we use

  • Ruby, Scala, Python, Google Apps Script
  • MongoDB, Redshift, Druid
  • Airflow, Jenkins
  • Spark, Hadoop
  • Why Poshmark?

    Poshmark is a leading social commerce platform for the next generation of retailers and shoppers. Through technology, our mission is to build the world’s most connected shopping experience, while empowering people to build thriving retail businesses. Since launching in 2011, Poshmark has become a vibrant social shopping community with ten million Seller Stylists helping 160 million users discover items they love from over 1.5 billion listings. For more information, please visit www.poshmark.com, or find us on Instagram, Facebook, Twitter, Pinterest and YouTube.

    About Us :

    At Poshmark, we’re constantly challenging the status quo and are looking for innovative and passionate people to help shape the future of Poshmark. We’re disrupting the industry by combining social connections with e-commerce through data-driven solutions and the latest technology to optimize our platform. We’re nothing without our amazing team who deliver an unparalleled social shopping experience to the millions of people we connect each day.

    We built Poshmark around four core values :

    Focus on people to create empowered communities that drive success.

    Together we grow to support each other to strive for our dreams.

    Lead with love to foster genuine connections built upon a foundation of respect.

    Embrace your weirdness to accept and empower one another on their own unique journey. We’re invested in our team and community, working together to build an entirely new way to shop. That way, when we win, we all win together. Come help us build the most connected shopping experience ever.

    Here’s what we’ll set you up with :

  • A team that is invested in your career growth and training
  • Competitive salary and equity, based on experience
  • Work alongside world-class talent
  • Flexible vacation / paid time off policy
  • Parental leave
  • Personal style encouraged (or not, whatever you’re in to)
  • Poshmark is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
  • Poshmark is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

    Create a job alert for this search

    Senior Data Engineer • tamil nadu, tamil nadu, in

    Related jobs
    • Promoted
    Senior Data Integration Engineer

    Senior Data Integration Engineer

    IndsafriTiruchirappalli, IN
    Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    PASO CoTiruchirappalli, IN
    We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 11 days ago
    • Promoted
    lead Data Engineer

    lead Data Engineer

    CozzeraTiruchirappalli, IN
    Location : Remote ( 1 week from noida office then remote).We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in. Delta Lake, Spark, MLflow), and modern orchestration ...Show moreLast updated: 23 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AIQUTiruchirappalli, IN
    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 23 hours ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Tiruchirappalli, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Inctiruchirappalli, tamil nadu, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Greystartiruchirappalli, tamil nadu, in
    We are looking for a strong Data Architect to join our engineering team, focusing on leveraging Azure SQL, Cosmos DB and DataBricks to meet our growing data demands. As a Data Leader in the Apex org...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Manuh TechnologiesTiruchirappalli, IN
    Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability. Troubleshoot and resolve data-relat...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsTiruchirappalli, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AITiruchirappalli, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Coffeee.ioTiruchirappalli, IN
    Lead Data Engineer – SnapLogic.Experience : 8+ years (with 3+ years in SnapLogic ETL).Lead Data Engineer – SnapLogic.The ideal candidate will have hands-on experience with.This role requires technic...Show moreLast updated: 23 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncTiruchirappalli, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeTiruchirappalli, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AITiruchirappalli, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 20 days ago
    • Promoted
    Senior Azure Data Engineer (8+ Yrs)

    Senior Azure Data Engineer (8+ Yrs)

    Delphi Consulting Middle EastTiruchirappalli, IN
    Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. Interviews and onboarding are condu...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticstiruchirappalli, tamil nadu, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladetiruchirappalli, tamil nadu, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Nityo InfotechTiruchirappalli, IN
    Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes.Minimum 5 years of experience in Data Engineering or Infrastructure roles. Proven hands-on experience with Apache Spark ...Show moreLast updated: 1 day ago