Owns the stability, accuracy, and signal quality of automated test execution by systematically analyzing, debugging, and resolving failing scripts across pipelines.
Key Responsibilities:
• Execute and monitor pipelines in Azure DevOps
• Categorize failures: Test defect vs environment vs data vs code
• Track trends and provide triage reporting
• Script-Level Debugging & Root Cause Analysis
• Debug automation scripts written in: Playwright / Selenium
• Identify root causes such as:
• Flaky selectors (dynamic DOM changes)
• Synchronization/timing issues (wait conditions)
• Assertion mismatches
• Data dependency failures
• Validate API failures using: Postman or GraphQL tools
• Inspect logs and telemetry (App Insights, pipeline logs)
Requirements
• Strong debugging and analytical skills
• Experience with logs, APIs, and UI troubleshooting
• Familiarity with test automation lifecycle
• Experience with observability tools (App Insights, Azure monitoring)
• Mortgage/FinTech experience
Originally posted on Himalayas