TechOps - CloudOps - DataOps - Senior

The opportunity

We are looking for a seasoned and proactive Senior DataOps Engineer to lead and manage data operations across modern Azure/AWS based data platforms. In this role, you will take ownership of mission-critical data pipelines, contribute to reliability engineering initiatives, and guide the continuous improvement of data ingestion, transformation, and monitoring processes. You will collaborate with cross-functional teams to drive operational excellence, troubleshoot complex issues, and help shape our DataOps strategy.

Your key responsibilities

• Ensure reliability and operational stability of enterprise data pipelines through proactive monitoring, incident management, troubleshooting, and continuous improvement across cloud data platforms.
• Lead the root cause analysis of recurring incidents, implement preventive actions, and establish best practices to improve system resilience.
• Mentor junior engineers and guide them in incident resolution, automation, and process standardization
• Collaborate with Data Engineering, DevOps, and Analytics teams to support production deployments and performance optimization.
• Proactively identify gaps in data and operational workflows and implement scalable solutions using scripting, automation, AI-assisted capabilities, Agentic AI patterns, and CI/CD practices.
• Drive improvements in operational processes by maintaining and enhancing runbooks, SOPs, and knowledge bases.
• Ensure compliance with data governance, logging, observability, and security best practices.
• Participate in rotational on-call duties and act as a point of escalation for complex operational issues
• Responsible for decision-making, optimizing processes, resource management, and overseeing team management as needed for task execution.
• Accountable for allocating personnel, supervising team members, assigning tasks, ensuring that the team has the necessary tools and support to succeed in their roles and optimizing and evaluating their performance to meet organizational goals.

Skills and attributes for success

• Deep understanding of cloud data services (Databricks, Snowflake, Data lakes, Informatica) and data engineering operational models.
• Solid understanding of ETL/ELT design and implementation principles.
• Strong SQL and PySpark skills for data transformation and validation.
• Strong problem-solving and analytical skills with a focus on proactive incident prevention.
• Experience building or supporting Agentic AI solutions integrated with enterprise data platforms, APIs, databases, or operational tools.
• Experience architecting AI agents for operational use cases such as incident triage, root cause analysis, data quality investigation etc.
• Ability to identify opportunities to apply AI-assisted automation within DataOps, improving monitoring, incident resolution, operational efficiency, and engineering productivity.
• Excellent communication and stakeholder collaboration abilities across distributed teams
• Leadership mindset with experience mentoring team members or guiding junior staff
• Attention to detail and a strong commitment to quality and documentation

To qualify for the role, you must have

• Bachelor’s degree in computer science and engineering, Data Analytics, or a related field, or equivalent work experience
• 5–8 years of experience working in data operations, data engineering support, or application management roles
• Strong experience supporting and maintaining cloud-based data pipelines, data storage and processing platforms, with hands-on experience in Databricks and Informatica.
• Expertise in root cause analysis, incident resolution, and monitoring for large-scale data workflows
• Experience with CI/CD tools like Azure DevOps, Git, and deployment automation
• Experience building or supporting Agentic AI solutions integrated with enterprise data platforms, APIs, databases, or operational tools.
• Proficiency in SQL and scripting languages such as Python or PySpark
• Solid understanding of data governance, performance tuning, and cloud-based data architecture best practices.
• Experience in global delivery models and distributed teams.
• Excellent stakeholder collaboration skills to translate business needs into scalable technical solutions.
• Willingness to participate in 24/7 support rotations or cover critical business hours

Technologies and Tools

Must have

• Strong hands-on experience with Data Factory, Data Lake/Amazon S3, Synapse/ Redshift, Databricks, Snowflake and Informatica.
• Strong root cause analysis skills across data pipelines, storage layers, and reporting.
• Hands-on scripting with Python or PySpark for automation or pipeline optimization.
• Strong SQL skills for data analysis, issue diagnosis, and validation
• Experience architecting AI agents for operational use cases such as incident triage, root cause analysis, data quality investigation etc.
• Experience leading incident resolution calls and engaging with business stakeholders

Good to have

• Experience integrating data from ERP, CRM, POS systems, or third-party APIs
• CI/CD experience using DevOps (pipelines, repos, artifacts)
• Hands-on exposure to enterprise AI development tools and frameworks such as Microsoft Foundry/Azure OpenAI, Microsoft Copilot Studio, LangChain, LangGraph, or equivalent technologies.
• Familiarity with LLM/agent observability, evaluation, tracing, security guardrails, and responsible AI practices.
• Certifications such as:
  • Azure / AWS Certified - Data Engineer Associate
  • Databricks Certified Data Engineer Professional
  • Snowflake SnowPro Core Certification
  • Informatica Cloud Data Integration Specialist

What we look for

• Enthusiastic learners with a passion for Dataop’s and practices.
• Problem solvers with a proactive approach to troubleshooting and optimization.
• Team players who can collaborate effectively in a remote or hybrid work environment.
• Ability to work in rotational shifts to support business-critical systems operating in a 24/7 environment.
• Detail-oriented professionals with strong documentation skills.

What we offer

At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. 

• Our Commitment: As a commitment, we persistently endeavour to embody our values, fulfil our purpose, and champion inclusiveness. Our dedication is to cultivate EY into an environment where diverse perspectives are celebrated, creating a supportive atmosphere for individuals to authentically be themselves and contribute their utmost.
• Professional Development: From entry-level employees to senior leaders, we believe in continuous learning. We offer opportunities to build new skills, take on leadership roles, and connect and grow through mentorship.
• People and Culture: In our dynamic workplace, diversity, equity, and inclusiveness are ingrained in our culture. We're united by a commitment to create an environment where every individual's differences are valued, practices are equ