Talent.com
Senior Data Engineer - Data Acquisition
Senior Data Engineer - Data AcquisitionInfoBeans • Kurnool, IN
Senior Data Engineer - Data Acquisition

Senior Data Engineer - Data Acquisition

InfoBeans • Kurnool, IN
14 days ago
Job description

About the Job

We are seeking a highly skilled Senior Data Engineer – Data Acquisition (ODS) to join our data engineering team. The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformation pipelines using Azure Data Platform , Databricks , Snowflake , and Kafka .

You will be responsible for designing, developing, and maintaining robust data acquisition frameworks that support large-scale analytics and operational data systems.

Job Title

Senior Data Engineer – Data Acquisition (ODS)

Skills

Kafka, Python, Spark, Databricks, SQL, Snowflake, Azure Data Factory (ADF), XML, JSON, Scala (Basic)

Experience Required : 5+ Years

Location : Remote

Notice Period : Immediate to 15 Days Preferred

Job Description

  • Design, develop, and maintain data ingestion and transformation pipelines in an Azure-based environment.
  • Work with Kafka for real-time data streaming and message queuing.
  • Build scalable ETL / ELT pipelines using Databricks (PySpark / Scala) and integrate with Snowflake for analytics workloads.
  • Develop and optimize SQL queries and stored procedures for performance and data accuracy.
  • Utilize Azure Data Factory (ADF) to orchestrate workflows and integrate with various data sources.
  • Work with structured and semi-structured data formats such as XML, JSON, Parquet, and CSV .
  • Collaborate with data architects, analysts, and business teams to deliver high-quality, reliable data pipelines.
  • Ensure code quality, version control, and data security best practices are followed.
  • Contribute to data architecture design discussions and provide technical recommendations for system improvements.

Key Responsibilities

  • End-to-end development of data acquisition solutions for operational and analytical systems.
  • Implement data transformation logic using Spark and Python.
  • Optimize performance of large-scale data pipelines in Databricks / Snowflake.
  • Handle real-time and batch data ingestion via Kafka and ADF.
  • Conduct data validation, profiling, and documentation of technical specifications.
  • Qualification & Certification

  • Bachelor’s degree in Computer Science, Information Technology, or related field.
  • Microsoft Azure or Snowflake certification (preferred).
  • Strong understanding of modern data engineering best practices.
  • Good to Have

  • Experience with DevOps tools and CI / CD pipelines for data deployment.
  • Exposure to data modeling and data warehouse design .
  • Familiarity with other streaming platforms or data orchestration tools.
  • About InfoBeans

    InfoBeans is a global digital transformation and product engineering company, enabling businesses to thrive through innovation, agility, and cutting-edge technology solutions. With over 1,700 team members across the globe, we specialize in custom software development, enterprise solutions, cloud, AI / ML, UX, automation, and digital transformation services.

    At InfoBeans, we live by our core purpose of “Creating WOW!” — for our clients, team members, and the community. Our collaborative culture, growth opportunities, and people-first approach make us one of the most trusted and rewarding workplaces.

    🔗 https : / / infobeans.ai /

    Create a job alert for this search

    Senior Data Engineer • Kurnool, IN

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Kurnool, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 5 days ago • Promoted
    Immediate Opening for Data Engineer (Databricks & D365)

    Immediate Opening for Data Engineer (Databricks & D365)

    GyanSys Inc. • Kurnool, IN
    Need to have databricks experience as well as experience with handling D365 data.Need strong SQL skills, strong analytical skills.Show more
    Last updated: 12 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Kurnool, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 18 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Saras Analytics • kurnool, andhra pradesh, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 30+ days ago • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • Kurnool, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 7 days ago • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek Consulting • Kurnool, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastek • kurnool, andhra pradesh, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • Kurnool, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 12 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Kurnool, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 22 days ago • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inc • kurnool, andhra pradesh, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show more
    Last updated: 21 days ago • Promoted
    Senior Data Engineer-Remote

    Senior Data Engineer-Remote

    Cimpress India • kurnool, andhra pradesh, in
    Remote
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Kurnool, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • Kurnool, IN
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Kurnool, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 22 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Co • kurnool, andhra pradesh, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more
    Last updated: 21 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straive • kurnool, andhra pradesh, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyati • Kurnool, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DataOrbit AI • kurnool, andhra pradesh, in
    DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more
    Last updated: 2 days ago • Promoted