Talent.com
This job offer is not available in your country.
Sr. SW Engineer (Data Engineering - Java, Hadoop, Spark, Python, 3-7 years Exp)

Sr. SW Engineer (Data Engineering - Java, Hadoop, Spark, Python, 3-7 years Exp)

ConfidentialBengaluru / Bangalore
30+ days ago
Job description

Authentication is an exciting and rapidly developing field, teeming with fresh and innovative ideas. With a strong demand for new solutions, this space promises to be a hotbed of innovation for the next 5 to 10 years. If you're eager to immerse yourself in the dynamic world of identity, risk measurement and consumer authentication, learn quickly, and make significant impacts, then the Risk and Identity team at VISA is the ideal place for you!

As a Sr Data Engineer, you'd be functioning as a design / development expert in a scrum team of 8-10 members. You'd have end-to-end ownership of your stories and deliveries. You'd be reporting to a Director of Authentication.

Essential Functions :

  • Demonstrates relevant technical working knowledge to understand requirements.
  • Work with Product owners, architects and other relevant stakeholders to gather and refine requirements for one or more products, taking in to account the existing tools and solutions across departments.
  • Translates functional requirements into system designs for one or more components and communicates how the components will interact.
  • Demonstrates understanding of non-functional requirements (NFR) and their impact on the system. Leads junior engineers in understanding requirements.
  • Design, Code, test, document and implement new applications & as well as existing programs.
  • Develop code that complies with design specifications and meets security and coding best practices.
  • Work independently and provide guidance to junior developers.
  • Work with team members on technical software development issues, problem analysis and resolution.
  • Participate in design and code review sessions as appropriate - to ensure the quality of work delivered by teammates is in accordance with development standards.
  • Write automation scripts to functionally automate the testing.
  • Learn and adopt technologies, like generative AI, that provide developer productivity improvements.
  • Engages with product engineering teams and product owners during code / design reviews, regular meetings, on-call rotations, and incident responses throughout product development and operations cycles.
  • Leverages advanced knowledge of systems or platforms and telemetry analyses to propose isolated improvements in code, processes, and designs to deliver on customer / business objectives more effectively.

Qualifications

Basic Qualifications

  • 3 - 7 years of work experience with a Bachelor's Degree or with an Advanced Degree.
  • Proven hands-on capability on development of data pipelines.
  • Experience in creating data driven business solutions and solving data problems using a wide variety of technologies such as Hadoop, Hive, Spark, Cassandra, NoSQL, as well as traditional data technologies (DB2 - RDBMS).
  • Design and development skills with Big Data technologies like Hadoop, Spark, Hive, Presto and Map Reduce.
  • Ability to program in one or more scripting / programming languages such as Python, Java or Scala.
  • Experience developing large scale, enterprise class distributed pipelines that require high availability, low latency & strong data consistency computing is a plus.
  • Experience with Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git, Bitbucket.
  • Experience in Graph processing technologies and graph databases such as GraphX and Neo4j is a plus.
  • Excellent communication skills (Written and Verbal).
  • Proactive & Collaborative mindset towards problem solving, automation and innovation in solution delivery.
  • Working knowledge of Machine Learning, Predictive AI & Generative AI is a plus.
  • Skills Required

    Hive, Hadoop, Spark, Java, Python

    Create a job alert for this search

    Sr Data Engineer • Bengaluru / Bangalore

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionshosur, tamil nadu, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 24 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Accion LabsBengaluru, Karnataka, India
    Data Engineer / Data Analyst (Hybrid Role).Data Analysis : Python, Pandas, NumPy, Strong SQL, EDA techniques, Data Visualization Tools, Statistical Knowledge. Data Engineering : SQL, ETL pipelines, Ai...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticshosur, tamil nadu, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 24 days ago
    • Promoted
    Senior Manager - Data Engineering Lead

    Senior Manager - Data Engineering Lead

    DIAGEO Indiahosur, tamil nadu, in
    Senior Manager - Data Engineering Lead.Bachelor’s or master’s degree in computer science, Data Engineering, or related field. Experience in data engineering.Proven experience in cloud platforms (AWS...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLhosur, tamil nadu, in
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIhosur, tamil nadu, in
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubeshosur, tamil nadu, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekhosur, tamil nadu, in
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 17 days ago
    • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Cognologix Technologieshosur, tamil nadu, in
    Bangalore / Pune / Hyderabad / Remote.We are looking for self driven Data Professional to be a key member of our Data Practice. We help many of our clients make sense of their large investments in data – ...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.hosur, tamil nadu, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago
    • Promoted
    GenAI Engineer

    GenAI Engineer

    Xebiahosur, tamil nadu, in
    Any Xebia Location (Hybrid, 3 days office per week).Building and deploying GenAI solutions leveraging.Collaborating with global teams under US overlap hours. AWS, GenAI, Bedrock, AgenticAI.Ability t...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    GenAI Engineer

    GenAI Engineer

    AlignX AIhosur, tamil nadu, in
    Generative AI revolution, building intelligent, autonomous agents that solve complex, real-world problems.Our mission is to move beyond simple chatbots and create sophisticated systems that can act...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    TechVeritohosur, tamil nadu, in
    You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CEShosur, tamil nadu, in
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 5 days ago
    • Promoted
    Sr. AWS Cloud Engineer

    Sr. AWS Cloud Engineer

    Mastekhosur, tamil nadu, in
    Cloud Engineer Job description : .Have work experience in the following areas : .Experience in designing, building, and maintaining AWS Cloud Infrastructure. Proficient in AWS services including EC2, S3...Show moreLast updated: 24 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Net Zero Insightshosur, tamil nadu, in
    Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide.Our cuttin...Show moreLast updated: 6 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalhosur, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Full Stack AI Engineer

    Sr. Full Stack AI Engineer

    ContexQhosur, tamil nadu, in
    Senior Full Stack Engineer – Enterprise Analytics Platform.Remote (Preference for India-based candidates).Competitive salary + significant equity package. At ContexQ, a Singapore based B2B SaaS AI S...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.hosur, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago