Talent.com
Senior Data engineer
Senior Data engineerConfidential • Pune, India
Senior Data engineer

Senior Data engineer

Confidential • Pune, India
12 days ago
Job description

As a Senior Software Engineer, you will act as a technical guide, mentor, and coach, providing guidance and support to your team, while fostering a positive and productive work environment. You will be expected to be hands on and delivery focused while optimizing development schedule and time to market. You will also be responsible for setting project and squad goals, prioritizing and completing initiatives, and delivering results in a product-led, empowered environment. Your leadership skills, ability to handle multiple collaborators and experience in software development and software engineering will be important to your success in this role

What You Will Deliver

  • Design and document sophisticated software components, services, and platforms
  • Implement robust and maintainable code with clear and maintained documentation
  • Deliver customer value in iterative fashion while working towards longer term systems to solve roadmap goals with increasing efficiency
  • Serve as a technical lead and own projects end-to-end
  • Communicate status and changes to the work they are responsible and accountable for, keep all collaborators informed of changes and updates to original plan
  • Test all code implemented through unit testing and integration testing
  • Work with internal and external teams to bring new products to market
  • Maintain and enhance software frameworks for development
  • Serve as a technical mentor for other engineers on the team
  • Participate in code reviews and contribute to the development of standard methodologies
  • Collaborate with multi-functional teams to identify and resolve platform-related issues
  • Support internal and external audit teams to prepare for and participate in security, software licensing, and regulatory audits, ensuring that all necessary documentation and evidence is available and accurate
  • Collaborate with multi-functional teams to implement new controls and procedures to address identified compliance gaps or risks

What you will need to be successful (experience and qualifications)

  • Technical skills we need from you
  • Bachelor's degree in computer science, Engineering, Computer Information Systems or equivalent work experience
  • Skillful in the ability to adapt to new technologies and processes, and be able to work independently and as part of a team
  • Skillful in problem-solving, with the ability to analyze sophisticated problems, identify root causes and develop creative and effective solutions
  • Excellent communication skills and ability to communicate with your peers through senior leaders.
  • You should be able to engage and influence others to collect requirements, describe what you're doing, work through problems, and find productive solutions
  • Self-starter, able to handle ambiguity, navigate uncertainty, identify risks, and find the right people and tools to get the job done
  • Skillful in Palantir Foundry development including good exposure to the ontology framework, and experience developing applications which extend the capabilities of the foundry platform.
  • Software skills

  • Skillful in at least one programming language (C#, Python, or TypeScript, JavaScript, React Native) developing cross-platform solutions.
  • Skillful in ontology design, data integration, secure data handling, Pipeline building using pipeline builder and code repository (PySpark), Workshop Design
  • Skillful in data engineering and data pipelines
  • Skillful in writing secure, stable, testable, and maintainable code with minimal defects
  • Skillful in systems design
  • Demonstrable in software development, with a focus on platform or service engineering
  • Skillful in software engineering practices & standard methodologies for full software development life cycle including coding standards, code reviews, source control management, continuous deployments, testing, and operations
  • Skillful in designing and building complex software systems end-to-end which have been effectively delivered and operated in production. You should understand security and privacy standard methodologies as well as how to properly monitor, log, and alarm production systems
  • Infrastructure skills
  • Skillful in building and scaling infrastructure services using Amazon Web Services or Microsoft Azure and Palantir Foundry
  • Skillful in understanding using core cloud application infrastructure services including identity platforms, networking, storage, databases, containers, and serverless
  • Skillful in fixing large-scale distributed production systems
  • Demonstrable working on production systems. You'll have supported these production systems.
  • Database skills
  • Skillful knowledge of databases, such as relational, graph, document, and key-value
  • Skillful ability in data modeling and database design
  • Skillful in SQL
  • Skills that set you apart
  • Possess a passion for mentoring and coaching engineers in both technical and soft skills
  • You have a product-centric attitude that you use to understand business needs. You have the technical and social skills to collaboratively design scalable systems and engineering solutions that meet those needs
  • You employ strong senses of empathy and curiosity to build the best possible experience for the users of your products
  • You focus on delighting customers with amazing user experiences and customer service
  • Additional Information

    We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.

    Even though the job is advertised as full time, please contact the hiring manager or the recruiter as flexible working arrangements may be considered.

    What you can expect from us!

    Our Commitment To Diversity, Equity And Inclusion

    At bp, you could be part of Business Resource Groups (BRGs) which belief in the power of inclusion, deeper connections, and shared experiences. They provide a place for employees to learn and share knowledge, to connect, and to improve. The BRGs focus on and encourage talent engagement, development, and retention while creating a broadened sense of community and inclusion for bp employees. The groups cultivate leadership growth by involving employees in developmental opportunities they would not otherwise have access to. Formal and informal mentoring also helps employees develop their professional goals and connect with colleagues. The BRGs' dedication to growth at all levels helps employees feel more engaged and energized. The BRGs break down barriers, so we can all do better together. Examples of BRGs include (but are not limited to) :

    bpWIN (bp Women's International Network)

    Pride

    Working parents

    PEN (Positively Ethnic Network)

    bpInclusia (bp's Asian community)

    bpEnergía (bp's Latin community)

    Skills Required

    pipeline building, Amazon Web Services, Pyspark, systems design , Sql, Typescript, Javascript, software engineering practices , Database Design, React Native, Microsoft Azure, Data Integration, Python

    Create a job alert for this search

    Senior Data Engineer • Pune, India

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • Pune, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyati • pune, maharashtra, in
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labs • pune, maharashtra, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Fusemachines • Pune, IN
    Quick Apply
    About Fusemachines Fusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Adjunct Associate Professor at Colu...Show more
    Last updated: 6 days ago
    Senior Data Engineer

    Senior Data Engineer

    Saras Analytics • Pune, Maharashtra, India
    About Saras Analytics : We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value.Our suite of work spans ex...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastek • pune, maharashtra, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Innova Solutions • pune, maharashtra, in
    We're Hiring : Lead Data Consultant / Senior Data Engineer.Industry : Financial Services & Insurance (FSI).Are you passionate about building scalable, cloud-native data platforms? Join our team to le...Show more
    Last updated: 22 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Co • pune, maharashtra, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more
    Last updated: 22 days ago • Promoted
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 19 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune, Maharashtra, India
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 22 days ago • Promoted
    Senior Data Engineer- AWS

    Senior Data Engineer- AWS

    InfoCepts • Pune, Maharashtra, India
    Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements. Should be able to design comple...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Pune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerx • Pune, Maharashtra, India
    We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straive • pune, maharashtra, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Pune, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SPIRO • Pune, Maharashtra, India
    We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Pune, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 6 days ago • Promoted