Devops, Agile, Method. & TestsDevops, Agile, Method. & Tests
Conference50min
INTERMEDIATE

Beyond %: a practical guide to coverage metrics (and when to ignore them)

This talk demystifies code coverage metrics—line, branch, and path—showing how they can mislead quality decisions. It links cyclomatic complexity to test needs, explores mutation testing, and identifies the “saturation zone” where more coverage stops adding value. Attendees learn to interpret reports and set meaningful, defect-focused coverage gates.

talk.summaryAiDisclaimer

Ivan Ponomarev
Ivan PonomarevSynthesized
talks.description
Code coverage is deceptively simple — until you try to make decisions from it. This talk explains the main metrics — line, statement, branch, and path coverage — shows how each can mislead, and explains when raising the percentage no longer raises quality. We will use small, clear examples to expose common coverage illusions (green lines and rising percentages that do not add test quality), show how cyclomatic complexity can bound the minimum number of tests you need (and when it does not), and discuss mutation testing as a complementary technique and its practical limitations. You will learn how to spot the saturation zone where chasing extra percent stops paying off, and how to set sensible gates that reward real defect-finding rather than vanity targets.
Key takeaways
• What line, branch, and path coverage actually measure, and their blind spots
• How cyclomatic complexity relates to required test cases (and when it does not)
• Practical tips for reading and interpreting coverage reports
• The trade-off between measurement precision and practical usability
• Why saturation happens and why setting meaningful coverage gates is hard
Target audience
Engineers, SDETs, and tech leads who own tests or quality gates and want actionable guidance beyond a single number.
complexity
testing
quality
coverage
talks.speakers
Ivan Ponomarev

Ivan Ponomarev

Synthesized

United Kingdom

Hello, I'm Ivan Ponomarev, currently a Tech Lead at Synthesized.io, where I spearhead the development of innovative solutions for creating high-quality data for application development and testing.

Before this, I tackled diverse challenges, from refining ERP systems to crafting real-time Internet data monitoring systems. Beyond my contributions to the industry, I'm also a faculty member at universities, where I blend practical tech insights with academic rigor. Additionally, I participate in a number of program committees for technical conferences.