Talent.com
This job offer is not available in your country.
Azure Data Engineer (Senior)

Azure Data Engineer (Senior)

Infogainbangalore, India
1 day ago
Job description

Azure Data Engineer (Senior) with skills Data Engineering, databricks, Pyspark for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)

Posted on : August 07, Share on Linkedin Share on Twitter Share on Facebook

ROLES & RESPONSIBILITIES

Job Profile Summary :

In this role, you will support the Data Engineering team in setting up the Data Lake on Cloud and the implementation of standardized Data Model. You will develop data pipelines for new sources, data transformations within the Data Lake, CI / CD and data delivery as per the business requirements.

Job Description :

  • Build pipelines to bring in wide variety of data from multiple sources within the organization as well as from social media and public data sources.
  • Collaborate with cross functional teams to source data and make it available for downstream consumption.
  • Work with the team to provide an effective solution design to meet business needs.
  • Ensure regular communication with key stakeholders, understand any key concerns in how the initiative is being delivered or any risks / issues that have either not yet been identified or are not being progressed.
  • Ensure dependencies and challenges (risks) are escalated and managed. Escalate critical issues to the Sponsor and / or Head of Data Engineering.
  • Ensure timelines (milestones, decisions and delivery) are managed and value of initiative is achieved, without compromising quality and within budget.
  • Ensure an appropriate and coordinated communications plan is in place for initiative execution and delivery, both internal and external.
  • Ensure final handover of initiative to business as usual processes, carry out a post implementation review (as necessary) to ensure initiative objectives have been delivered, and any lessons learned are fed into future initiative management processes.

Who we are looking for :

Competencies & Personal Traits

  • Work as a team player
  • Excellent problem analysis skills
  • Excellent in the Azure Databricks platform

  • Experience with at least one Cloud Infra provider (Azure / AWS)
  • Experience in building data pipelines using batch processing with Apache Spark (Spark SQL, Dataframe API)
  • Knowledge of Big data ETL processing tools
  • Basic knowledge of scripting (shell / bash)
  • Experience of working with multiple data sources including relational databases (SQL Server / Oracle / DB2 / Netezza), NoSQL / document databases, flat files
  • Basic understanding of CI CD tools such as Jenkins, JIRA, Bitbucket, Artifactory, Bamboo and Azure Dev-ops.
  • Basic understanding of DevOps practices using Git version control
  • Ability to debug, fine tune and optimize large scale data processing jobs
  • Working Experience

  • 1-3 years of broad experience of working with Enterprise IT applications in cloud platform and big data environments.
  • Professional Qualifications

  • Certifications related to Data and Analytics would be an added advantage
  • Education

  • Master / bachelor’s degree in STEM (Science, Technology, Engineering, Mathematics)
  • Language

  • Fluency in written and spoken English
  • EXPERIENCE

  • 6-8 Years
  • SKILLS

  • Primary Skill : Data Engineering
  • Sub Skill(s) : Data Engineering
  • Additional Skill(s) : databricks, Pyspark
  • ABOUT THE COMPANY

    Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ : MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).

    Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.

    Create a job alert for this search

    Azure Data Engineer • bangalore, India

    Related jobs
    • Promoted
    Senior Azure Data Engineer - Full remote - contractor in USD

    Senior Azure Data Engineer - Full remote - contractor in USD

    All European Careershosur, tamil nadu, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote SeniorAzure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databrick...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionshosur, tamil nadu, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 26 days ago
    • Promoted
    Azure Data Engineer Lead

    Azure Data Engineer Lead

    Creative Synergies GroupBengaluru, Karnataka, India
    Creative Synergies Group Overview.Creative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and D...Show moreLast updated: 2 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesBengaluru, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 28 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    XebiaBengaluru, Karnataka, India
    We’re Hiring | Azure Data Engineer | Bangalore (Hybrid).Bangalore (Hybrid, 3 days office / week).Azure Data Factory (ADF), Databricks (ADB), Data Lake (ADLS Gen2). ETL, Data Pipelines, Data Transforma...Show moreLast updated: 26 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Servicesbangalore, karnataka, in
    Job Title : Azure Data Engineer.Required Skillset : Azure Databricks(Strong),scala(strong), Pyspark(Good to have).Azure Databricks using Scala, PySpark. Software Development Life Cycle experience.Work...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticshosur, tamil nadu, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIhosur, tamil nadu, in
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubeshosur, tamil nadu, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 16 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Wissen InfotechBengaluru, Karnataka, India
    Azure Data Engineer Know anyone who is interested!! Share your resumes to adilakshmi.Wissen Infotech is hiring for Bangalore. Job Title : Azure Data Engineer.Years of Experience : 8 plus years.Locatio...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Purview Data Engineer

    Azure Purview Data Engineer

    LTIMindtreeBengaluru, Karnataka, India
    LTIMindtree is proud to be an equal opportunity employer.We are committed to equal employment opportunity regardless of race, ethnicity, nationality, gender, gender-identity, gender expression, lan...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.hosur, tamil nadu, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iobangalore district, karnataka, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceshosur, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer | Azure + Databricks

    Data Engineer | Azure + Databricks

    XebiaBengaluru, Karnataka, India
    Job Opportunity – Data Engineer | Azure + Databricks Location : Bangalore (Whitefield) | Hybrid (3 days office / week) Experience : 6+ years Notice Period : Immediate to 2 weeks – only apply if you c...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Evolenthosur, tamil nadu, in
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Net Zero Insightshosur, tamil nadu, in
    Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide.Our cuttin...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLbangalore, karnataka, in
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BrightEdgehosur, tamil nadu, in
    BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of da...Show moreLast updated: 27 days ago