This job offer is not available in your country.
Data Engineering Senior Advisor
ConfidentialHyderabad / Secunderabad, Telangana30+ days ago
Job descriptionWork with business and technical leadership to understand requirements Design to the requirements and document the designs Ability to write product-grade performant code for data extraction, transformations and loading using Spark, Py -Spark Do data modeling as needed for the requirements Write performant queries using Teradata SQL, Hive SQL and Spark SQL against Teradata and Hive Implementing dev-ops pipelines to deploy code artifacts on to the designated platform / servers like AWS or Hadoop Edge Nodes Implement Hadoop job orchestration using Shell scripting, Apache Oozie, CA7 Enterprise Scheduler and Airflow Troubleshooting the issues, providing effective solutions and jobs monitoring in the production environment Participate in sprint planning sessions, refinement / story-grooming sessions, daily scrums, demos and retrospectives
Experience Desired :
- Experience in Jira and Confluence
- Health care domain knowledge is a plus
- Excellent work experience on Hadoop as data warehouse
- Experience in Agile and working knowledge on DevOps tools
- Spark, Py -Spark, Shell scripting, Teradata, Hive and Hadoop
- SQLs (using Teradata SQL, Hive SQL and Spark SQL) and Stored Procedures
- Git, Jenkins, Artifactory
- Unix / Linux Shell scripting (KSH) and basic administration of Unix servers
- CA7 Enterprise Scheduler
- AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch)
- Databricks ( Delta lake , Notebooks, Pipelines, cluster management, Azure / AWS integration)
- Exercises considerable creativity, foresight, and judgment in conceiving, planning, and delivering initiatives.
Education and Training Required :
Primary Skills :
Additional Skills :
Skills Required
Hive, Spark, Teradata, Databricks, Aws
Create a job alert for this search
Data Engineering • Hyderabad / Secunderabad, Telangana
Related jobs
- Promoted
Infrastructure Engineering Senior Advisor
EvernorthHyderabad, India Evernorth Health Services, a division of The Cigna Group (NYSE : CI), creates pharmacy, care, and benefits solutions to improve health and increase vitality.
We relentlessly innovate to make the pred...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
EXLHyderabad, Telangana, India The role involves building and optimizing ETL / ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI / ML, and business intelligence use cases.AWS (S...Show moreLast updated: 30+ days ago
- Promoted
Data Modeling Advisor
EvernorthHyderabad, India Evernorth Health Services, a division of The Cigna Group (NYSE : CI), creates pharmacy, care, and benefits solutions to improve health and increase vitality.
We relentlessly innovate to make the pred...Show moreLast updated: 30+ days ago
- Promoted
Senior Engineering Manager-Big Data, Generative AI
Extreme NetworksHyderabad, IN Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions.They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver...Show moreLast updated: 24 days ago
- Promoted
Emerging Technology & Innovation Advisor
Nexora Tech SolutionsHyderabad, IN Join Nexora Tech as a Strategic Partner – Emerging Technology & Innovation Advisor.Former CIO – SBI, HSBC, and leadership positions at HDFC Bank, Capgemini, Oracle and Citi), is a.AI / ML strategy, I...Show moreLast updated: 2 days ago
- Promoted
Senior Data Integration Engineer
IndsafriHyderabad, IN Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 1 day ago
- Promoted
Sr Manager, Data Engineering
McDonalds in IndiaHyderabad, India Looking to hire a Senior Engineer at the G5 level who has a deep understanding of Data Product Lifecycle, Standards and Practices.
Will be responsible for building scalable and efficient data soluti...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
TezoHyderabad, Telangana, India Tezo is a new generation Digital & AI solutions provider, with a history of creating remarkable outcomes for our customers.
We bring exceptional experiences using cutting-edge analytics, data profic...Show moreLast updated: 10 days ago
- Promoted
Senior Data Engineer
Infogainhyderabad, telangana, in Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers.
You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
- Promoted
Data Engineering Advisor
ConfidentialHyderabad / Secunderabad, Telangana Design and implement ETL processes to extract, transform, and load data from various sources.Collaborate with cross-functional teams to understand data requirements and deliver solutions.Optimize a...Show moreLast updated: 30+ days ago
- Promoted
Senior Analyst - Data Engineering
ConfidentialHyderabad / Secunderabad, Telangana Lead delivery of key Enterprise Data Warehouse and Azure Data Lake projects within time and budget.Drive solution design and build to ensure scalability, performance and reuse of data and other com...Show moreLast updated: 30+ days ago
- Promoted
Azure Data Engineering
LTIMindtreeHyderabad, IN We are hiring for ADB +ADF +Py spark +SQL +Synapse.Specialist - Data Engineering 5 to 8 Yrs.Senior Specialist - Data Engineering 8 to 12 yrs.Show moreLast updated: 30+ days ago
- Promoted
Data Engineering Azure databricks
EXLHyderabad, IN Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.
Work with stakeholders to unders...Show moreLast updated: 17 days ago
- Promoted
Senior Data Engineer
Saransh IncHyderabad, Telangana, India Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled.
The ideal candidate will be hands-on, detail-o...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
USEReadyhyderabad, telangana, in Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 12 days ago
- Promoted
Software Engineering Senior Advisor
EvernorthHyderabad, India Evernorth Health Services, a division of The Cigna Group (NYSE : CI), creates pharmacy, care, and benefits solutions to improve health and increase vitality.
We relentlessly innovate to make the pred...Show moreLast updated: 30+ days ago
- Promoted
Data Engineering Associate Advisor
ConfidentialHyderabad / Secunderabad, Telangana Design and implement ETL processes to extract, transform, and load data from various sources.Collaborate with cross-functional teams to understand data requirements and deliver solutions.Optimize a...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Saras AnalyticsHyderabad, Telangana, India We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value.
Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago