Talent.com
This job offer is not available in your country.
Sr. Data Engineer (Python, Spark, Hadoop, Hive, 4-7 years' experience)

Sr. Data Engineer (Python, Spark, Hadoop, Hive, 4-7 years' experience)

VisaBangalore, Karnataka, India
8 hours ago
Job description

Job Description

Visa is seeking highly energetic, passionate, technology enthusiast for Data Engineering team.

The successful candidate will work as a Senior Data Engineer and be part of the Risk Solution Services team to design and develop solutions for all data requirements. The ideal candidate will bring robust technical strength in developing solutions in extremely high volume, low latency ETL workflow design and also bring an excellent understanding of data. This role will participate in design discussions, create solutions, develop programs and ensure successful delivery of business capabilities. This role will assume technical ownership of multiple applications and create robust and scalable solutions.

Visa provides a challenging environment of volume, velocity and variety that is rarely matched.

Candidates looking forward to thrive in such environment are encouraged to apply.

Responsibilities :

  • Experience on developing, maintaining and supporting big data ETL pipelines (Hadoop, Hive, Spark)
  • Responsible for the implementation and test of scalable distributed ensuring security, timeliness and quality of data.
  • Experience supporting production systems
  • Work closely with other engineers and peers to design and develop ETL pipelines
  • Work with product managers in understanding and clarifying on the requirements
  • Demonstrate inclination towards continuous learning and professional development.
  • Proven track record of quickly acquiring new skills and knowledge in a fast-paced environment.

This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications

  • 5+ years of relevant work experience and Bachelors degree or with an Advanced Degree
  • 4+ years of experience in Hadoop using Core Java Programming, Scala, Spark, Kafka, Hive on Linux / Unix environment.
  • Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.)
  • Experience in writing Spark and Hive code to process large data sets in Hadoop environments
  • Strong experience with SQL for extracting, aggregating, and processing big data using Hadoop
  • Development experience in one or more of the following : Scala, Python or Java.
  • Basic experience with Unix / Shell or Python scripting
  • Exposure to Scheduling tools like Airflow and Control – M will be a plus
  • Experience using VCS like Git
  • Basic understanding of RDBMs viz, MS SQL, DB2, Oracle, etc. for data retrieval
  • Understanding of Kafka, Apache Hudi is a plus.
  • Thrive in self-motivated internal innovation driven environment.
  • Adapting fast to new application knowledge and changes.
  • Additional Information

    Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

    Create a job alert for this search

    Data Engineer Python • Bangalore, Karnataka, India

    Related jobs
    • Promoted
    • New!
    Sr. Hadoop Kafka Lead Engineer

    Sr. Hadoop Kafka Lead Engineer

    Anicalls (Pty) LtdBengaluru, Karnataka, India
    Sound knowledge of relational databases (SQL) and experience with large SQL-based systems.Experience with Java and shell scripting. Excellent analytical capabilities - Strong interest in algorithms....Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Data Analytics Engineer

    Senior Data Analytics Engineer

    Prudential plcBengaluru, Karnataka, India
    We are seeking a highly skilled Data Engineer to join our global organization.The ideal candidate will have a minimum of 5 years of experience in data engineering, with a strong background in Spark...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    ETL Data Engineer – AWS & Python Specialist

    ETL Data Engineer – AWS & Python Specialist

    EastvantageBangalore Rural, Karnataka, India
    We're Hiring : ETL Data Engineer – AWS & Python Specialist!.We are seeking an experienced ETL Data Engineer to design, develop, and maintain robust data pipelines using AWS cloud services and Python...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

    Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Hadoop / Bigdata Engineer

    Senior Hadoop / Bigdata Engineer

    Anicalls (Pty) LtdBengaluru, Karnataka, India
    Work closely with our QA Team to ensure data integrity and overall system quality.Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and ...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    White ForceBengaluru, Karnataka, India
    Minimum 12 + years of IT experience in Data background.Develop and manage data models, schemas, and.Hands-on experience building and implementing. Optimize performance of Snowflake data warehouse.Wo...Show moreLast updated: 8 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    We have an opening for TCS, Bangalore "Data Engineer- Python+Pyspark,GCP Developer".Skill : Data Engineer- Python+Pyspark,GCP Developer. Data Engineer- Python+Pyspark,GCP Developer.Hands-on developm...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    GCP Senior Data Engineer

    GCP Senior Data Engineer

    TalentOlaBengaluru, Karnataka, India
    GCP Senior Data Engineer Job description as below : .Solid knowledge about developing.Dataflow, Fusion, Cloud Composer, Pub / Sub, Cloud Function, Kubernetes.Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Sr. Data Engineer (Hybrid in Bangalore)

    Sr. Data Engineer (Hybrid in Bangalore)

    SmartsheetBengaluru, Karnataka, India
    For over 20 years, Smartsheet has helped people and teams achieve–well, anything.From seamless work management to smart, scalable solutions, we’ve always worked with flow.We’re building tools that ...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Zettamine - Sr. Data Engineer

    Zettamine - Sr. Data Engineer

    NexthireBengaluru, Karnataka, India
    Job Title : Senior Data Engineer (PySpark).We are looking for a highly skilled and experienced Senior Data Engineer to join our team in Bangalore. The ideal candidate will have a strong background in...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Sr. Data Engineer - AWS+Python+Pyspark Job

    Sr. Data Engineer - AWS+Python+Pyspark Job

    YASH TechnologiesBengaluru, Karnataka, India
    YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences,...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Data Engineer - Sr. Consultant level (Hadoop, Spark, Python, GenAI, 11-15 years exp)

    Data Engineer - Sr. Consultant level (Hadoop, Spark, Python, GenAI, 11-15 years exp)

    VisaBangalore, Karnataka, India
    This is a great opportunity to work with Engineering and AI team to scale and structure large scale data engineering and AI / ML that drives significant revenue for Visa. As a member of the Post Purch...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Data Engineer - (Big Data, Spark, Scala, Java, Python, Cassandra, Elasticserach, AWS, Airflow, RDBMS, SQL)

    Senior Data Engineer - (Big Data, Spark, Scala, Java, Python, Cassandra, Elasticserach, AWS, Airflow, RDBMS, SQL)

    The Nielsen CompanyBengaluru, Karnataka, India
    At Nielsen, we believe that career growth is a partnership.You ultimately own, fuel and set the journey.By joining our team of nearly 14,000 associates, you will become part of a community that wil...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Sr. Data Engineer 1

    Sr. Data Engineer 1

    SkyworksBengaluru, Karnataka, India
    If you are looking for a challenging and exciting career in the world of technology, then look no further.Skyworks is an innovator of high performance analog semiconductors whose solutions are powe...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    ParexelBengaluru, Karnataka, India
    When our values align, there's no limit to what we can achieve.With a focus on automating testing and DevOps, use Microsoft Azure data PaaS services, design, build, modify, and support data pipelin...Show moreLast updated: 8 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIBengaluru, IN
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ImpetusBangalore Urban, Karnataka, India
    Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive.Good hands-on experience of python and Bash Scripts. Good understanding of SQL and data warehouse concepts.Strong analytic...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    LifesightBengaluru, Karnataka, India
    We're Hiring! Data Engineer - Bangalore.Lifesight is on a mission to empower businesses with advanced data intelligence!. We are a fast-growing SaaS company helping brands leverage data & AI for bet...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Sr. Databricks Developer

    Sr. Databricks Developer

    LabCorpBangalore, Karnataka, India
    The Senior Databricks Developer will be responsible to implement and maintain solutions in AWS Databricks platform.You will be responsible for coordinating data requests from the various teams, rev...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Sr. Analytics Data Engineer

    Sr. Analytics Data Engineer

    DAT Freight & AnalyticsBengaluru, Karnataka, India
    SaaS technology company that has been at the leading edge of innovation in transportation supply chain logistics for 45 years. We continue to transform the industry year over year, by deploying a su...Show moreLast updated: 8 hours ago