Software success metrics

Quantifying outcomes to deliver software at speed from idea to production is based on three focus area: Speed, Efficiency and Risk.

Focus on Speed

 

Measuring the rate of software change is based on the deployment frequency and time from commit to deploy. High performing IT organization can deploy on demande and take less than one hour to deploy a commit. Uses cases include application delivery and Build pipelines.

  

DEPLOYMENT FREQUENCY

TIME FROM COMMIT TO DEPLOY

HIGH IT PERFORMERS

On-demand

< 1 Hour

MEDIUM IT PERFORMERS

Week – Month

Week – Month

LOW IT PERFORMERS

Month – 6 Month

Month – 6 month

Focus on Efficiency

 

Measuring the effectiveness of software change is based on the change failure rate and mean time to resolve failure. High performing IT organization have less than 15% failure rate and are solved in less than 1 hour. Uses cases include Configuration Management and Server drift.

 

CHANGE FAILURE RATE

MEAN TIME TO RESOLVE

HIGH IT PERFORMERS

0-15%

< 1 Hour

MEDIUM IT PERFORMERS

31-45%

< 1 Day

LOW IT PERFORMERS

16-30%

< 1 Day

Focus on Risk

 

Measuring the quality of software change is based on the compliance audit frequency and the time to deploy a remediation. High performing IT organization can audit compliance on-demand and can deploy a remediation in less than 1 hour. Uses cases include Compliance automation and Compliance coverage.

 

COMPLIANCE AUDIT FREQUENCY

TIME DEPLOYING REMEDIATION

HIGH IT PERFORMERS

On-Demand

< 1 Hour

MEDIUM IT PERFORMERS

Week – Month

Week – Month

LOW IT PERFORMERS

Month – 12 Months

Month – 6 Months

Enterprise with high performing IT organizations were twice as likely to exceed their profitability, market share, and productivity goals – The State of DevOps, 2016

Continuous S.A.
Avenue des Hauts-Fourneaux 9
L-4362 Esch-sur-Alzette
Luxembourg

© Continuous S.A. 2017