Quantifying outcomes to deliver software at speed from idea to production is based on three focus area: Speed, Efficiency and Risk.
Software success metrics
Focus on Speed
Measuring the rate of software change is based on the deployment frequency and time from commit to deploy. High performing IT organization can deploy on demande and take less than one hour to deploy a commit. Uses cases include application delivery and Build pipelines.
DEPLOYMENT FREQUENCY
TIME FROM COMMIT TO DEPLOY
HIGH IT PERFORMERS
On-demand
< 1 Hour
MEDIUM IT PERFORMERS
Week – Month
Week – Month
LOW IT PERFORMERS
Month – 6 Month
Month – 6 month
Focus on Efficiency
Measuring the effectiveness of software change is based on the change failure rate and mean time to resolve failure. High performing IT organization have less than 15% failure rate and are solved in less than 1 hour. Uses cases include Configuration Management and Server drift.
CHANGE FAILURE RATE
MEAN TIME TO RESOLVE
HIGH IT PERFORMERS
0-15%
< 1 Hour
MEDIUM IT PERFORMERS
31-45%
< 1 Day
LOW IT PERFORMERS
16-30%
< 1 Day
Focus on Risk
Measuring the quality of software change is based on the compliance audit frequency and the time to deploy a remediation. High performing IT organization can audit compliance on-demand and can deploy a remediation in less than 1 hour. Uses cases include Compliance automation and Compliance coverage.
COMPLIANCE AUDIT FREQUENCY
TIME DEPLOYING REMEDIATION
HIGH IT PERFORMERS
On-Demand
< 1 Hour
MEDIUM IT PERFORMERS
Week – Month
Week – Month
LOW IT PERFORMERS
Month – 12 Months
Month – 6 Months
Enterprise with high performing IT organizations were twice as likely to exceed their profitability, market share, and productivity goals – The State of DevOps, 2016
Continuous S.A.
9 avenue du Blues,
L-4368, Belvaux
Luxembourg
© Continuous S.A. 2017