Introduction
In my last article, I introduced the concept of Objectives and Key Results (OKRs) and provided an illustration based on personal application. However, I only tried out personal OKRs because I wanted a way to “learn by doing” before I started trying out some of my thinking on incorporating them in SAFe. This article will explore the first application in SAFe: Improving Product Strategy.Late last year, Product Management guru John Cutler wrote a brilliant article called “12 signs you’re working in a Feature Factory”. Some highlights include:
- No connection to core metrics. Infrequent discussions about desired customer and business outcomes.
- “Success Theater” around shipping with little discussion about impact.
- Culture of hand-offs. Front-loaded process in place to “get ahead of the work” so that items are ready for engineering”. Team is not directly involved in research, problem exploration, or experimentation and validation.
- Primary measure of success is delivered features, not delivered outcomes.
- No measurement. Teams do not measure the impact of their work.
- Mismatch between prioritization rigour (deciding what gets worked on) and validation rigour (deciding if it was, in fact, the right thing to work on).
His blog is a gold-mine for Product Managers, and I found much of his thinking resonated with me when it came to the difference between a healthy ART and a sick one. OKRs are a very handy tool in combating the syndrome.
Introducing OKRs to Feature Definitions
The official guidance says “every feature must have defined benefits”. We teach it in every class, and our Cost of Delay estimates should be based on the defined benefits but it is frightening how few ARTs actually define benefits or expected outcomes for features. At best, most scratch out a few rarely referenced qualitative statements.Imagine if every feature that went into a Cost of Delay (COD) estimation session or PI planning had a clearly defined set of objectives and key results!
Following is an illustration based on an imaginary feature for a restaurant wanting to introduce an automated SMS-based reservation reminder capability.
Applying OKRs to PI Objectives
I’ve lost count of the number of long discussions I’ve had about the difference between PI Objectives and Features. They almost always start the same way. “Surely our PI Objective is to deliver Feature X”. Or, in an ART with a lot of component teams it might be “Support Team A in delivering Feature X”.
WRONG!
Good PI objectives are based on outcomes. Over the course of the planning event, the team unpacks their features and generates stories to capture the ongoing conversation and identify key inter-dependencies. Eventually, we consolidate what we’ve learned about the desired outcomes by expressing them as PI objectives. The teams don’t commit to delivering the stories, they commit to achieving the objectives. They should be working with their product owners all the way through the PI to refine and reshape their backlogs to maximize their outcomes.
If every feature that enters PI planning has a well-defined set of OKRs, we have a great big hint as to what our objectives are. An ART with good Devops maturity may well transpose the Feature OKRs straight into their PI objectives (subject to trade-off decisions made during planning). They will ship multiple times during the PI, leveraging the feedback from each deployment to guide their ongoing backlog refinement.
SAFe Principle 9 suggests enabling decentralization by defining the economic logic behind the decision rather than the decision itself. Using well-defined OKRs for our PI objectives provides this economic logic, enabling Product Owners and teams to make far more effective trade-off decisions as they execute.
However, without good DevOps maturity the features may not have been deployed in market for sufficient time by the end of the PI to be measuring the predefined Key Results. In this case, the team needs to work to define a set of Key Results they will be able to measure by the time the PI is over. These should at minimum be demonstrating some level of incremental validation of the target KRs. Perhaps they could be based on results from User Testing (the UX kind, not UAT). Or maybe, measured results in integration test environments. For example:
- 50% of test users indicated they were highly likely to recommend the feature to a friend or colleague
- End-to-end processing time reduced by 50% in test environments.
Last but not least, we’ve started to solve some of the challenges ARTs experience with the “Business Value” measure on PI objectives. It should be less subjective during the assignment stage at PI Planning and completely quantitative once we reach Inspect and Adapt!
Outcome Validation
By this point, we’ve started to address a number of the warning signs. But, unless we’re some distance down the path to good DevOps we haven’t really done much about validation. If you read my recent Feature Kanban article, you’ll have noticed that the final stage before we call a feature “done” was “Impact Validation”.
This is the moment for final leverage of our Feature OKRs. What happened once the feature is deployed and used in anger? Do the observed outcomes match expectations? Do they trigger the generation of an enhancement feature to feed back through our Program Backlog for the next Build/Measure/Learn cycle? Do they affect the priorities and value propositions of other features currently in the Program Backlog?
Linking it back to the ART PI Metrics dashboard
In the business impact quadrant of my PI metrics model, I proposed that every ART should have a “fitness function” defining the fashion in which the ART could measure its impact on the business. This function is designed to be enduring rather than varying feature by feature – the intended use is to support trend-based analysis. The job of effective product managers is, of course, to identify features which will move the strategic needles in the desired direction. Business Features should be contributing to Business Impacts, Enablers might be either generating learning or contributing to the other three quadrants.
Thus, what we should see is Key Result measures in every feature that exert force on the strategic success measures for the ART. Our team level metric models should be varying with feature content to enable them to steer. This helps with the first warning sign Cutler identifies:
- No measurement. Teams do not measure the impact of their work. Or, if measurement happens, it is done in isolation by the product management team and selectively shared. You have no idea if your work worked.
Conclusion
Whilst OKRs obviously have a lot to offer in the sphere of Product Strategy, this is not the only area in which they might help us with SAFe. In my next article, I’ll explore applying them to Relentless Improvement.
According to the overview discharged by CompTIA, about 68% of the HR administrators show PMP® confirmation noteworthy when contrasted with just 30% three years prior. ExcelR PMP Certification
ReplyDeleteGreat Article Artificial Intelligence Projects
DeleteProject Center in Chennai
JavaScript Training in Chennai
JavaScript Training in Chennai
Pretty blog, so many ideas in a single site, thanks for the informative article, keep updating more article.
ReplyDeleteDigital Marketing Course in Chennai
Digital Marketing Course in Chennai
Digital Marketing Courses in Bangalore
Digital Marketing Course in Coimbatore
Digital Marketing Course in Madurai
Nice blog was really feeling good to read it. Thanks for this information.
ReplyDeleteSpoken English Classes in Chennai
English Speaking Course in Chennai
french classes
pearson vue test center in chennai
IoT Training in Chennai
Xamarin Training in Chennai
Node JS Training in Chennai
content writing training in chennai
Spoken English Classes in OMR
Spoken English Classes in Porur
iso certification in noida
ReplyDeleteiso certification in delhi
ce certification in delhi
iso 14001 certification in delhi
iso 22000 certification cost
iso consultants in noida
iso 27001 certification services
ReplyDeleteiso 27001 certification in delhi
ISO 9001 Certification in Noida
iso 22000 certification in Delhi
If your looking for Online Illinois license plate sticker renewals then you have need to come to the right place.We offer the fastest Illinois license plate sticker renewals in the state.ExcelR pmp certification
ReplyDeleteAttend The PMP Certification From ExcelR. Practical PMP Certification Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The PMP Certification.
ReplyDeleteExcelR PMP Certification
Positive site, where did u come up with the information on this posting?I have read a few of the articles on your website now, and I really like your style. Thanks a million and please keep up the effective work. small sandblaster
ReplyDeletevery interesting post.this is my first time visit here.i found so mmany interesting stuff in your blog especially its discussion..thanks for the post! www.yoursafetyspy.com
ReplyDelete
ReplyDeletepython course in coimbatore
java course in coimbatore
python training in coimbatore
java training in coimbatore
php course in coimbatore
php training in coimbatore
android course in coimbatore
android training in coimbatore
datascience course in coimbatore
datascience training in coimbatore
ethical hacking course in coimbatore
ethical hacking training in coimbatore
artificial intelligence course in coimbatore
artificial intelligence training in coimbatore
digital marketing course in coimbatore
digital marketing training in coimbatore
embedded system course in coimbatore
embedded system training in coimbatore
python course in coimbatore
ReplyDeletepython training in coimbatore
java course in coimbatore
java training in coimbatore
android course in coimbatore
android training in coimbatore
php course in coimbatore
php training in coimbatore
digital marketing course in coimbatore
digital marketing training in coimbatore
software testing course in coimbatore
software testing training in coimbatore
Thanks a lot very much for the high quality and results-oriented help. I won’t think twice to endorse your blog post to anybody who wants and needs support about this area.
ReplyDeleteCloud Business Management Software Suite
This post is very simple to read and appreciate without leaving any details out. Great work!
ReplyDeletepmp certification
A good blog always comes-up with new and exciting information and while reading I have feel that this blog is really have all those quality that qualify a blog to be a one.
ReplyDelete360DigiTMG AI Course in Malaysia
This is an awesome motivating article.I am practically satisfied with your great work.You put truly extremely supportive data. Keep it up. Continue blogging. Hoping to perusing your next post
ReplyDelete360DigiTMG
It is a really good strategy to make changes. You also need to manage the workforce shifting. Without proper management, its whole system can be down and there will be a loss of production. So business process outsourcing company is giving the professional workers to solve this problem.
ReplyDeleteDevelopment of IT sectors are faster than anything, that leads to the decrease of internet cost. Besides this, increases more innovative ways to decrease the main cost of the business. IP phone quebec is creating new option because of lower maintenance bill.
ReplyDeleteI’m going to read this. I’ll be sure to come back. thanks for sharing. and also This article gives the light in which we can observe the reality. this is very nice one and gives indepth information. thanks for this nice article... Benefits of CBD for Back Pain
ReplyDeleteNice to read your article! I am looking forward to sharing your adventures and experiences. CBDfx Gummies
ReplyDeleteThis was really an interesting topic and I kinda agree with what you have mentioned here! Sexy Cop Outfits
ReplyDeleteI read that Post and got it fine and informative. top 10 reviews
ReplyDeleteYou have to do local marketing also. You can set up LED video walls to attract the local customer. It has clear and attractive quality and also it costs little than other advertising system.
ReplyDeletePretty good post. I just stumbled upon your blog and wanted to say that I have really enjoyed reading your blog posts. Any way I'll be subscribing to your feed and I hope you post again soon. Big thanks for the useful info. bestcheapro
ReplyDeleteTo be productive implies that you are clear leaning and zeroed in on what you need to achieve. how long does cbd oil take to work
ReplyDeleteIt can likewise make an impression for your business of having intriguing assortment of products they can buy. where to buy cbd oil in salt lake city
ReplyDeleteI found so many interesting stuff in your blog especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here! keep up the good work... buy Ecstasy
ReplyDeleteI will truly value the essayist's decision for picking this magnificent article fitting to my matter.Here is profound depiction about the article matter which helped me more.
ReplyDeleteAI Courses
You delivered such an impressive piece to read, giving every subject enlightenment for us to gain information. Thanks for sharing such information with us due to which my several concepts have been cleared. mini moto
ReplyDeleteExcelR provides . PMP® certification. It is a great platform for those who want to learn and become a PMP®. Students are tutored by professionals who have a degree in a particular topic. It is a great opportunity to learn and grow.
ReplyDeletePMP® certification
This is such a great resource that you are providing and you give it away for free. kids boxing gloves
ReplyDeleteAwesome article! I want people to know just how good this information is in your article. It’s interesting, compelling content. Your views are much like my own concerning this subject. motorcycle jackets
ReplyDeleteYou have beaten yourself this time, and I appreciate you and hopping for some more informative posts in future. Thank you for sharing great information to us. best projector under 300
ReplyDeleteThank you for some other informative website. The place else may just I get that kind of information written in such a perfect method? I have a venture that I am simply now running on, and I’ve been at the glance out for such info. gaming chair with footrest under $100
ReplyDeleteYes i am totally agreed with this article and i just want say that this article is very nice and very informative article.I will make sure to be reading your blog more. You made a good point but I can't help but wonder, what about the other side? !!!!!!Thanks commercial hot water pressure washer
ReplyDelete
ReplyDeleteExcelR provides PMP Certification. It is a great platform for those who want to learn and become a PMP Certification. Students are tutored by professionals who have a degree in a particular topic. It is a great opportunity to learn and grow.
PMP Certification
Very intresting, thanks for sharing such amazing information with us. Visit Ogen Infosystem for creative Web Designing Company in Delhi and Digital Marketing Company in Delhi, India.
ReplyDeleteWeb Designing Company in Delhi
Appslure best Mobile app development company in mumbai. We provide service hire dedicated app developer and website developer in Mumbai.
ReplyDeleteI recently came across your blog and have been reading along. I thought I would leave my first comment. I don't know what to say except that I have enjoyed reading. Nice blog. I will keep visiting this blog very often. https://trippyrepublic.com
ReplyDeleteMua vé tại đại lý Aivivu, tham khảo
ReplyDeletevé máy bay đi Mỹ Vietnam Airline
vé máy bay về việt nam từ mỹ
chuyến bay từ đức về hà nội hôm nay
vé máy bay nhật về việt nam
gia ve may bay vietjet tu han quoc ve viet nam