A Meaningful Dashboard for Agile Teams

Metrics are important for Agile teams. It is wiser to focus on a handful of simple balanced metrics rather than hoard of metrics that does not give much value to the team or organization. In fact, it creates more noise.  A good team creates the metrics to understand how it is doing, what it needs to improve and makes the metrics available to the entire organization in the spirit of visibility and transparency. Stakeholders keep an eye on the metrics to see how the team is performing on its commitments. The leaders should review the metrics from time to time. Any question on an odd looking metric should be followed-up with a sense of concern. Their focus should be on helping the team, empowering the team and supporting it to move towards excellence rather than judging, discriminating or criticizing. The Servant Leadership role, such as Scrum Master or an Agile Champion, is needed to bring in effectiveness by understanding the metrics and using the data to help the team grow in effectiveness.  An ideal dashboard should kindle curiosity, emotions and questions. If any stakeholder questions the relevancy of data, the Scrum Master and the team should review the feedback objectively and update the dashboard as appropriate. While there are many attractive metrics available, care should be taken to choose a few meaningful ones, especially when a new team has just begun its journey. Here are some considerations to make while deciding your set of metrics. Value – Are we giving high value to our end users and customers? How can we show or display this on our dashboard? Predictability – What is the ability to deliver on commitments? Productivity – Consistently delivering same or more amount of work in the timeboxed period (iteration). Quality – How free from defects are the products we build? Sustainable Pace –  The teams should continue to work at a sustainable pace, indefinitely.  Happiness (Growth) – Are the people and teams learning, growing and happy?  Let us now dive a little deeper into what metrics can represent the above themes. Value can only be measured after the product has been released in the market. Did we meet our desired outcomes? If yes, then we got high value from our product. If no, what are we doing about meeting our desired outcomes in the upcoming sprints? Does our current/future work reflect the feedback that will help us reach or move towards our desired outcomes? Predictability should be measured as a trend. We should measure the last Sprint Predictability and also the Average Predictability from the last 3, 5 and 10 Sprints. This will show the trend. If the trend is consistent or slowly becoming better, it’s a good thing. If it’s going down, or it’s random all the time, that should be of concern to the team and for the leaders to see what the team needs. Maybe the team needs coaching and understanding on how to deliver to the commitment.   It could also be that the product owner and the business side need coaching, as they could be putting too much pressure on the team during the sprint to take on additional or non-committed work after the sprint starts, thereby disrupting the rhythm. The Scrum Master may need coaching if he/she is commanding the team to self-organize, when the team is still in the forming/storming stage and may benefit more from direction than just delegation (at the current time).  Productivity is measured in terms of Velocity. We recommend that as in case of predictability,  the team should display its last sprint velocity and also the average velocity for past 3,5 and 10 sprints. Velocity should also be reported as two numbers. Most people are familiar with velocity as the total number of points delivered in a sprint. However, working with many teams over the years, I have come to realize that while the total points delivered per sprint may be close to the committed points, the actual points delivered were not the same as the committed points or the points committed at the beginning of the sprint. This shows that either the planning is not robust or there are impediments in the system or the culture that disrupts the planned work more often than not. As a result, even high performing teams may be exchanging their committed scope to deliver a different set of work than they planned for. True velocity numbers, can uncover a lot of hidden problems in teams and how they work. It could also mean that the backlog items are not being groomed properly. Working with unhealthy and incomplete backlog items, teams often find they are unable to proceed with a story they started, forcing them to exchange the incomplete story with another one in the backlog. Velocity numbers are never to be compared between teams, although a team can benefit from comparing its own velocity between sprints.  Quality: As a team becomes effective  and displays Agile Values and Principles in its behaviors (example: collaborating, storming, swarming, cross-functionally diverse, carrying a musketeer’s attitude, etc.), they take pride in their work and that reflects  not only in them meeting their commitments but delivering work with a high quality. What this means is that the production defects should continue to decline, and should ideally drop close to zero with time. Metrics such as “Defects found in the past 3, 6 and 10 sprints” should reflect exactly that. “Meantime to resolve defects”, especially P1 and P2, should be minimized, which also shows proactiveness of an Agile team in resolving past defects and creating less technical debt.  Code-complexity is another important metric that can be measured. There are tools that help measure cyclomatic complexity, which actually tells the risk inherent in any build, determining how complex the code is. A team should also display a Sprint Report for the last completed sprint where some of these numbers are displayed in a table format; example total points committed, points added after sprint started, points removed

Transform Your Team, Elevate Your Business!

Subscribe to the Agilonomics Newsletter and Claim Your Free Power Team Consultation Today!

We promise to keep your email address safe. You can check our Privacy Policy.

Thank you for subscribing to our Agile Wisdome - Weekly Tips!

You’re almost there! Please check your email and click the confirmation link to complete your subscription. If you don’t see the email, be sure to check your spam folder.