Talent.com
Staff Data Engineer

Staff Data Engineer

ANSR Summit ConsultingGurgaon, India
30+ days ago
Job description

Role and Responsibilities :

  • Participate in the entire data pipeline lifecycle, focusing on building data lakes, data warehouses and related processes
  • Contribute to the design and documentation of our data lake platform
  • Partner with Sr staff on the development and maintenance of data governance policies and procedures that ensure data quality, accuracy, consistency, and privacy.
  • Mentor other data engineers, providing technical guidance, and ensuring that team members have the necessary skills and resources to perform their duties.
  • Conduct code and design reviews with junior and peer developers
  • Write clean code to develop data pipelines and necessary infrastructure as code
  • Aid in setting coding standards for team members to follow
  • Partner with cross functional teams to understand requirements and effectively design appropriate solutions.
  • Monitor and troubleshoot performance, scalability, and security issues, making improvements as needed
  • Aid in determining and implementing KPIs for performance and stability of platform
  • Participate in the review of new technologies and tools for our data teams
  • Partner with engineering and other cross functional teams to collect and implement technical and design requirements
  • Communicate effectively with technical and non-technical team members to ensure alignment and successful execution of projects.
  • Participate in cross-functional initiatives, promoting a culture of data-driven decision-making and continuous improvement.
  • Participate in an on call rotation.

Job Requirement :

  • 8 years of related experience; or 6 years and an advanced degree
  • Bachelors degree in engineering, computer science, math, data engineering or another related field or equivalent work experience
  • Experience in the development of modern data architecture, analytics, data governance, AI / ML, or related areas.
  • Strong Experience with AWS big data technologies including EMR, Glue, S3, EKS, Lambda, Athena, RDS, MKS / Kafka / Kinesis
  • Expertise with relational and NoSQL databases such as PostgresQL, Cassandra, DynamoDB, MongoDb etc and data modeling principles
  • Knowledge of data pipeline tools and workflow engines, e.g. Apache Airflow and Spark.
  • Experience with DevOps, including CI / CD pipelines, containerized deployment / Kubernetes, and infrastructure-as-code / AWS Cloud Formation / Terraform.
  • Successfully contributes to the entire development lifecycle of teams products
  • Exposure to secure coding practices, access controls, authentication, and audit. AWS Lake formation preferred.
  • Strong experience with SQL (SQL Server, Postgres) and Python, Scala
  • Identify opportunities for process improvement as well as efficiency in solutions
  • Demonstrated ability to mentor junior team members
  • Excellent analytical and time management skills, with a proven ability to deliver value independently
  • Strong written and verbal communication skills, with demonstrated experience providing technical input to technical and non-technical stakeholders
  • Ability to participate in on-call rotation
  • Preferred :

  • FinTech industry experience
  • Understanding of MPP Data Warehouse (Redshift, Greenplum)
  • Experience with Graph database
  • Create a job alert for this search

    Staff Engineer Data • Gurgaon, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Jaipur RugsGhaziabad, IN
    Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 14 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Delhi, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIDelhi, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 26 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGDelhi, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIDelhi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradDelhi, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AS Technology CorporationNoida, Uttar Pradesh, India
    The ideal candidate will have strong hands-on experience in.GitHub-based development workflows.Apache Spark (Batch & Streaming).Show moreLast updated: 15 days ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsDelhi, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 9 days ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPDelhi, IN
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseDelhi, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeDelhi, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalDelhi, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 18 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc.Delhi, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionDelhi, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyDelhi, IN
    Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL DigitalDelhi, IN
    Grab the excellent opportunity with our company.Notice Period : Immediate to 15days.Location : Bangalore / Hyderabad / Pune / Chennai / Noida / Ahmedabad. Years in Data Engineering with GCP.Interested people ca...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXDelhi, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response InformaticsDelhi, IN
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 18 days ago