Talent.com
Principal Data Solutions Engineer

Principal Data Solutions Engineer

EXLHyderabad, Republic Of India, IN
30+ days ago
Job description

Job Summary :

We are seeking an experienced Data Engineer with strong expertise in AWS cloud services and Databricks to design and implement scalable, high-performance data pipelines. The role involves building and optimizing ETL / ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI / ML, and business intelligence use cases.

Key Responsibilities :

  • Design, develop, and maintain data pipelines and workflows using AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena) and Databricks .
  • Build and optimize ETL / ELT processes for large-scale structured and unstructured datasets.
  • Leverage Databricks for data engineering, advanced analytics, and machine learning workloads.
  • Collaborate with data scientists, analysts, and stakeholders to deliver reliable and scalable data solutions.
  • Implement data governance, quality checks, and monitoring frameworks .
  • Ensure high availability, scalability, and cost-effectiveness of data solutions.

Required Skills :

  • 7+ years of experience in data engineering .
  • Strong hands-on experience with AWS cloud services (S3, Redshift, Glue, EMR, Athena, Lambda, Kinesis).
  • Expertise in Databricks (PySpark, Delta Lake, ML pipelines).
  • Proficiency in Python and SQL for data transformation and querying.
  • Strong understanding of data warehousing, data modeling, and big data frameworks .
  • Experience with workflow orchestration tools (Airflow, Step Functions).
  • Preferred Qualifications :

  • Familiarity with MLOps / ML integration within Databricks.
  • Experience with real-time / streaming data (Kafka, Spark Streaming).
  • Knowledge of infrastructure as code (Terraform / CloudFormation).
  • Exposure to data security, compliance, and governance practices.
  • Create a job alert for this search

    Principal Data Engineer • Hyderabad, Republic Of India, IN

    Related jobs
    • Promoted
    Principal Engineer

    Principal Engineer

    Mancer Consulting ServicesHyderabad, Telangana, India
    Shared Responsibility Models : Define and implement clear shared responsibility models, ensuring accountability across teams for infrastructure, platforms and application security and reliability.Co...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tanla Platforms LimitedHyderabad, Telangana, India
    We are seeking a skilled Data Engineer with 5–10 years of experience to join our dynamic Data Engineering team.The ideal candidate will design, build, and optimize large-scale data pipelines and wa...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    OptumHyderabad, Telangana, India
    Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions. Utilize knowledge of variou...Show moreLast updated: 21 days ago
    • Promoted
    Principal Data Systems Engineer

    Principal Data Systems Engineer

    FoodsmartHyderabad, Republic Of India, IN
    Foodsmart is the leading telenutrition and foodcare solution, backed by a robust network of Registered Dietitians.Our platform is designed to foster healthier food choices, drive lasting behavior c...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroHyderabad, Telangana, India
    Key Responsibilities : - Configure, deploy, and maintain Quantexa software on cloud platforms such as AWS, Azure, or Google Cloud. Design, implement, and optimize data pipelines and integration work...Show moreLast updated: 30+ days ago
    • Promoted
    Data Solutions Engineer

    Data Solutions Engineer

    OptumHyderabad, Republic Of India, IN
    Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions. Utilize knowledge of variou...Show moreLast updated: 21 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Saransh IncHyderabad, Republic Of India, IN
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 21 days ago
    • Promoted
    Principal Engineer, Financial Data Solutions

    Principal Engineer, Financial Data Solutions

    ANSRHyderabad, Republic Of India, IN
    ANSR is hiring for one of its clients.NASDAQ : TMUS), headquartered in Bellevue, Washington, is America’s supercharged Un-carrier, connecting millions through its strong nationwide network and flags...Show moreLast updated: 27 days ago
    • Promoted
    AWS Data Solutions Engineer

    AWS Data Solutions Engineer

    CoforgeHyderabad, Republic Of India, IN
    We are looking for a passionate and experienced.This role requires a strong foundation in cloud technologies, data processing, and programming, with a focus on building scalable and efficient data ...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Solutions Architect

    Principal Data Solutions Architect

    StraiveHyderabad, Republic Of India, IN
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    CoforgeHyderabad, Telangana, India
    Familiarity with the financial services industry, including banking, wealth management, or investment platforms.Hands-on experience with ETL tools such as DBT, SSIS, Informatica, or Snowflake.Knowl...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Solutions Engineer

    Lead Data Solutions Engineer

    CoforgeHyderabad, Republic Of India, IN
    Bachelor's degree in computer science, Information Systems, or related field.Proven expertise in Greenplum (PostgreSQL-based MPP), AWS (S3, EC2, Glue, Lambda) etc. Hands on experience in Databricks ...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Science Engineer

    Principal Data Science Engineer

    ValueMomentumHyderabad, Republic Of India, IN
    Analyze complex data sets to identify trends, patterns, and insights that can drive business decisions.Design and develop predictive models, algorithms, machine learning, and artificial intelligenc...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    ValueLabsHyderabad, Republic Of India, IN
    As a Senior Data Engineer, you will be the lead architect and builder of the data backbone for our entire next-generation digital asset platform. Embedded within our "Agentic AI & Automation" squad,...Show moreLast updated: 8 days ago
    • Promoted
    Principal Data Solutions Engineer

    Principal Data Solutions Engineer

    GenpactHyderabad, Republic Of India, IN
    Ready to build the future with AI?.At Genpact, we don’t just keep up with technology—we set the pace.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI G...Show moreLast updated: 13 days ago
    • Promoted
    Principal Data Solutions Engineer

    Principal Data Solutions Engineer

    Deutsche BörseHyderabad, Republic Of India, IN
    Headquartered in Frankfurt, Germany, Deutsche Börse Group is a leading international exchange organization and market infrastructure provider. They empower investors, financial institutions, and com...Show moreLast updated: 10 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    ValueMomentumHyderabad, Republic Of India, IN
    We are seeking a Senior Databricks Data Engineer with experience in designing and developing data pipelines using Azure Databricks, Data Factory, and Datalake. The role involves managing large volum...Show moreLast updated: 12 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Saras AnalyticsHyderabad, Republic Of India, IN
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago