Talent.com
IT Data Engineer

IT Data Engineer

ConfidentialHyderabad / Secunderabad, Telangana, India
4 days ago
Job description

The IT Data Engineer plays a critical role in enabling data-driven decision-making across the organization by designing, building, and maintaining robust data infrastructure. This position is responsible for developing scalable data pipelines, managing databases and data warehouses, and ensuring the integrity, accessibility, and quality of enterprise data. Through thoughtful architecture and efficient processing systems, the Data Engineer supports analytical initiatives and empowers teams with reliable, well-organized data assets.

Key Responsibilities

  • Design, build, and maintain scalable data pipelines to extract, transform, and load data from diverse sources into centralized repositories (e.g., data warehouses, data lakes)
  • Develop and manage databases, data warehouses, and data lakes to support analytics and reporting needs
  • Write and maintain efficient code and scripts for data processing, transformation, and manipulation
  • Ensure data quality, consistency, and reliability across all systems and pipelines
  • Implement and uphold data security, privacy, and access controls in compliance with governance standards
  • Collaborate with cross-functional teams to deliver data solutions aligned with business objectives
  • Monitor and optimize the performance, scalability, and cost-efficiency of data infrastructure
  • Create and maintain clear documentation for data architecture, processes, and workflows
  • Stay current with emerging data engineering technologies and recommend improvements to existing systems
  • Design and implement data models and schemas to support analytical and machine learning use cases
  • Build curated datasets and data marts to enable self-service analytics for business users
  • Establish monitoring and alerting systems to proactively detect and resolve data pipeline issues
  • Support machine learning operations by collaborating with data scientists on feature engineering and model deployment
  • Leverage cloud platforms (e.g., AWS, Azure, GCP) to build and maintain modern, scalable data infrastructure
  • Contribute to data governance initiatives by ensuring compliance with internal policies and external regulations

While the job description describes what is anticipated as the requirements of the position, the job requirements are subject to change based upon any changing needs and requirements of the business.

Required Skills

  • Proficiency in designing, building, and supporting large-scale data warehouses using cloud platforms such as Azure, AWS, or Google Cloud
  • Strong experience with Big Data technologies (e.g., Snowflake, Hadoop, Spark), data modeling (OLTP / OLAP), and database design and management
  • Skilled in writing and debugging complex SQL scripts and Python-based data processing using libraries such as Pandas and PySpark
  • Hands-on experience with ETL / ELT processes, orchestration tools (e.g., Apache Airflow, Azure Data Factory), and CI / CD practices
  • Familiarity with containerization and deployment tools like Docker and Kubernetes
  • Experience with version control systems such as Git
  • Knowledge of streaming data technologies (e.g., Kafka, Spark Streaming) for real-time data processing
  • Understanding of data governance, privacy practices, and compliance regulations
  • Existing technical knowledge of modern systems software, protocols, and standards, including SQL Server, Snowflake / Databricks / Fabric, and Power BI
  • Experience with data visualization tools such as Power BI or Tableau
  • Ability to translate business requirements into scalable technical solutions
  • Strong analytical, problem-solving, and troubleshooting skills
  • Excellent communication and collaboration abilities across technical and non-technical teams
  • Detail-oriented with a strong focus on data quality, consistency, and reliability
  • Comfortable working independently and in a fast-paced, team-oriented environment
  • Familiarity with Agile or Scrum methodologies is a plus
  • Required Experience

  • Bachelor's degree in Computer Science, Software Engineering or related field.
  • 5+ years of experience in data engineering or BI / reporting roles with a strong back-end focus
  • Tungsten Automation Corporation, Inc. is an Equal Opportunity Employer M / F / Disability / Vets

    Tungsten Automation Corporation, Inc. is an Equal Opportunity Employer M / F / Disability / Vets

    Skills Required

    Pyspark, Kafka, Tableau, Data Modeling, ELT, Apache Airflow, Docker, snowflake , Python, Aws, Hadoop, Power Bi, Olap, Sql Server, Sql, Google Cloud, Git, Spark Streaming, Azure Data Factory, Pandas, Spark, Databricks, Azure, Kubernetes, fabric , Oltp, Etl

    Create a job alert for this search

    Data Engineer • Hyderabad / Secunderabad, Telangana, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Optumhyderabad, telangana, in
    Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions. Utilize knowledge of variou...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Senior Engineer, It Data T500-21233

    Senior Engineer, It Data T500-21233

    ANSRHyderabad, Republic Of India, IN
    To Care for People on Life's Journey®.Together with our American Eagle regional partners, we offer thousands of flights daily to more than 350 destinations in more than 60 countries.American Airlin...Show moreLast updated: 19 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneHyderabad, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Tanla Platforms LimitedHyderabad, Telangana, India
    We are seeking a skilled Data Engineer with 5–10 years of experience to join our dynamic Data Engineering team.The ideal candidate will design, build, and optimize large-scale data pipelines and wa...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    CoforgeHyderabad, India
    Familiarity with the financial services industry, including banking, wealth management, or investment platforms.Hands-on experience with ETL tools such as DBT, SSIS, Informatica, or Snowflake.Knowl...Show moreLast updated: 30+ days ago
    • Promoted
    Softobiz - Data Engineer - Synapse Analytics

    Softobiz - Data Engineer - Synapse Analytics

    Softobiz Technologies Pvt ltdHyderabad
    Description : Job Title : Data Engineer.Career-defining role available with Tier 1 Blue Chip Australian Client.As a Data Engineer, you will be involved in all phases...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    ClearDemandHyderabad, IN
    Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 1 day ago
    • Promoted
    Senior Engineer - IT Data [T500-20555]

    Senior Engineer - IT Data [T500-20555]

    ANSRHyderabad, Telangana, India
    ANSR is hiring for one of its clients.To Care for People on Life's Journey®.Together with our American Eagle regional partners, we offer thousands of flights daily to more than 350 destinations in ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Prudent Technologies and Consulting, Inc.hyderabad, telangana, in
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 30+ days ago
    • Promoted
    IT Data Architect

    IT Data Architect

    ANSRHyderabad, Republic Of India, IN
    ANSR is hiring for one of its clients.To Care for People on Life's Journey®.Together with our American Eagle regional partners, we offer thousands of flights daily to more than 350 destinations in ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Technogen India Pvt. Ltd.hyderabad, telangana, in
    Design, build, and measure complex ELT jobs to process disparate data sources and form a high integrity, high quality, clean data asset. Executes and provides feedback for data modeling policies, pr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Recrosecunderabad, telangana, in
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticshyderabad, telangana, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    IT Data Engineer

    IT Data Engineer

    ConfidentialHyderabad / Secunderabad, Telangana
    The Data Engineer will be responsible for development, transformation and ongoing quality management of business data objects sourced from a wide range of internal / external systems with differing s...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Prudent Technologies and Consulting, Inc.Hyderabad, Republic Of India, IN
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpresssecunderabad, telangana, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 1 day ago
    • Promoted
    Senior Engineer, IT Data [T500-21233]

    Senior Engineer, IT Data [T500-21233]

    ANSRhyderabad, telangana, in
    To Care for People on Life's Journey®.Together with our American Eagle regional partners, we offer thousands of flights daily to more than 350 destinations in more than 60 countries.American Airlin...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight Globalsecunderabad, telangana, in
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago