Skip to content
management

Measuring Agile Teams Without Weaponizing the Numbers

What the charts show, what they leave out, and what to check next

  • Agile
  • Metrics
  • Project Management
  • Engineering Management

Why metrics are complicated

I've been on teams that tracked nothing, and it was like flying blind. Are we going to make the release date? Are we getting faster or slower? No idea. I've also been on teams where metrics became weapons: a way to rank teams or explain why everyone should work the weekend. Neither experience made me want a bigger dashboard.

What I want from a chart is a better question. If work is taking longer, where is the time going? If more items are completing, are users getting something better? Before changing anything, I want to know what changed in the work, what changed in how it was recorded, and what the people doing it can explain.

That gives me a simple reading habit: observation, possible explanations, next check. A chart can establish a pattern in the recorded data. It rarely establishes someone's motive, and it doesn't automatically tell us what caused the pattern.

Start with the outcome

The charts below describe work and delivery. They need company: evidence that the product helps someone, that quality is holding up, and that the way of working is sustainable.

Take a new search feature. Shipping it by March tells us about delivery. Search adoption tells us whether people use it. Neither tells us whether they find what they need. More searches could mean the feature is useful, or that navigation has become confusing. I'd pair adoption with task success, time to a useful result, and a few observed sessions before celebrating.

The same discipline applies inside the team. Define the question, the unit, the start and finish boundaries, and the period being measured. Write down changes to those definitions. Otherwise a process change and a measurement change can look exactly alike.

Five charts, read with context

Every example below is fictional. The interactions are demonstrations of how to read data, not benchmarks or evidence about any real team. Open the values beneath a figure to inspect the numbers behind it.

Sprint burndown

A sprint burndown shows the estimated work remaining in the current selection over time. Reaching zero means that recorded quantity reached zero. It doesn't establish that the Sprint Goal was achieved or that the result was useful. The Sprint Goal is the commitment; selected work is a forecast that can be renegotiated as the team learns, without endangering the goal. 1

In this example, the line reaches zero before the end. Switch work logs: one records all the original work completed; the other records some work removed after a scope decision. The line alone cannot distinguish them.

The same caution applies to the other familiar shapes. A flat stretch could mean blocked work, work too large to finish quickly, or a reporting delay. A cliff could reflect several completions recorded together, acceptance in batches, or one large item. An upward step could reflect added work or a revised estimate. My next check is the item history and the team's explanation, including what happened to the Sprint Goal. I wouldn't read under-commitment or a broken agreement directly from the line.

Release burndown and burnup

Across a release, remaining work combines two moving quantities: scope and completion. That's why I often prefer a burnup here. It draws completed work and total scope separately, so a team can be completing work while the distance to the current scope stays the same.

The examples keep completed work identical and change scope. In the growing-scope case, the gap is larger. That might reflect useful discovery, a necessary correction, or avoidable churn. The chart doesn't choose among them. Inspect what changed, why it changed, and whether smaller increments are reaching users.

Any date inferred from these lines depends on assumptions about future scope and delivery. A ruler through the recent slope is a scenario, not a promise. If those assumptions change, update the forecast and its uncertainty while the decision is still useful.

Velocity

Velocity usually means the amount of estimated work completed in a sprint, often summarized across recent sprints. Some teams find it useful for forecasting. Scrum requires neither story points nor velocity. 1

The arithmetic is easy: 500 points at 50 per sprint suggests ten sprints. The assumptions do the hard work. Does the remaining work resemble the sample? Are capacity, estimation, quality requirements, and scope still comparable? More history can help when the system is comparable; older data can mislead after it changes.

A gap between planned and completed points invites a conversation about changed scope, interruptions, dependencies, estimates, and unfinished work. It isn't a measure of effort. Rising points could reflect easier delivery, a different work mix, or a different estimation scale. New teams don't owe us an upward curve, and a mature team doesn't owe us flat bars.

What bothers me is using velocity as a score. Points aren't a common unit across teams, and even comparisons within one team need context. I'd keep the recent range visible alongside any average, and check whether the forecast is helping decisions rather than quietly becoming a target people must hit.

Completed cycle time and unfinished work

Cycle time measures elapsed time from a defined start to a defined finish. Work-item age measures elapsed time since starting something that is still unfinished. Throughput counts finished items per period; work in progress counts started, unfinished items. These four measures belong together. 2

This is a cycle-time scatterplot: each dot is a completed item, positioned by its completion day. The line is calculated from the latest five completed items. It helps us inspect patterns; without calculated control limits, it doesn't tell us whether the process is statistically in control.

The narrow sample looks reassuring. Now reveal the unfinished work: one item is already 18 days old. It is absent from the completion history because it hasn't finished. A short average among completed items doesn't tell us that nothing is waiting.

A long completed item deserves investigation, even if it is the only one. A rising average also deserves context: work mix, waiting, dependencies, and changes to the finish boundary can all matter. Inspect actual item histories and active ages; don't assume equal point estimates make two items comparable.

Variation doesn't make forecasting impossible. It makes an average alone less informative. A service level expectation combines a duration with a probability, grounded in relevant history, rather than promising every item will match the mean. Revisit it as the workflow changes. 2

Cumulative flow

A cumulative flow diagram shows how work accumulates across defined states over time. Here, the bottom band is cumulative finished work; the thickness of each unfinished band shows how many items occupy that state at each snapshot. Its definition matters: this example separates queued work from started work.

A widening active band tells us more items are started and unfinished at those snapshots. It doesn't tell us whether the cause is a dependency, a changed work mix, an interruption, or a status-recording problem. I'd inspect the oldest items and where they wait, then check the team's WIP policies.

A shrinking queue needs context too. It could reflect an intentional wind-down or a gap in replenishment. And a steady band can still contain one aging item while newer items pass through. The aggregate points us toward the work; it doesn't replace looking at it.

Delivery, quality, and the experience of doing the work

Delivery measures help connect the board to production. DORA's guide, updated in January 2026, uses five software delivery performance metrics rather than the historical four: 3

MeasureWhat it describes
Change lead time
Time from a code commit to production deployment
Deployment frequency
How often deployments occur
Failed deployment recovery time
Time to recover from a failed deployment requiring immediate intervention
Change fail rate
The proportion of deployments requiring immediate intervention
Deployment rework rate
The proportion of deployments that are unplanned responses to production incidents

Read them together for a particular application or service, with its context intact. They're useful inputs to improvement, not a league table. Faster deployment is a delivery capability; whether the changes improve customers' lives needs separate evidence. 3

Quality needs its own questions. What defects escape to users? How severe are they? What happens to support demand and reliability? A rising coverage percentage tells us more code is exercised by tests; it doesn't, by itself, show that those tests catch the failures that matter.

Then ask about the work people experience. SPACE describes productivity across satisfaction and well-being, performance, activity, communication and collaboration, and efficiency and flow. Its useful challenge is that one activity count cannot stand in for all of that. 4

DevEx offers a related lens: feedback loops, cognitive load, and flow state. Pair system data with what developers report. A review queue gives us waiting times; a conversation may reveal that reviewers lack context, or that the same person is constantly interrupted. Those lead to different experiments. 5

A small reading checklist

ObservationWhat I would check next
Remaining selected work reached zero
Completion and scope logs, then the Sprint Goal and usable result
Release scope outpaces completion
What was added, why, and which forecast assumptions changed
Completed points changed
Work mix, capacity, estimate scale, and scope changes
Completed items look fast
Ages and blockers of the items still in progress
An active band widened
Individual waiting times, workflow boundaries, and WIP policies
Deployments increased
Failure and rework measures, then user outcomes
People report friction
Where it occurs, whom it affects, and what would make it better

When the numbers and the team's account disagree, I don't want to pick a winner. I want to understand the gap. Sometimes the recording is wrong; sometimes the aggregate hides something people see every day; sometimes a familiar story doesn't survive the data.

That's where becomes useful: choose an obstacle, make a prediction, run a small experiment, and compare what happened. The dashboard has done its job when it helps that conversation happen.

Further reading

  • explores the research connecting delivery capability and organizational performance. Pair the book with the for today's metric definitions.
  • goes deeper into flow data, cycle-time distributions, and forecasting with uncertainty.
  • is a practical companion when the next question concerns interruptions, feedback, or cognitive load.

This is the middle post in Classical Agile. Start with the , then continue with to turn observations into experiments.

References

  1. Ken Schwaber and Jeff Sutherland (2020). The Scrum Guide. Scrum Guides. View source
  2. The Kanban Guide. Kanban Guides. View source
  3. Nathen Harvey (2026). DORA's Software Delivery Performance Metrics. DORA Guides. View source
  4. Nicole Forsgren and Margaret-Anne Storey and Chandra Maddila and Thomas Zimmermann and Brian Houck and Jenna Butler (2021). The SPACE of Developer Productivity: There's More to It Than You Think. ACM Queue. View source
  5. Abi Noda and Margaret-Anne Storey and Nicole Forsgren and Michaela Greiler (2023). DevEx: What Actually Drives Productivity. ACM Queue. View source
The opinions and views expressed on this blog are solely my own and do not reflect the opinions, views, or positions of my employer or any affiliated organizations. All content provided on this blog is for informational purposes only.