SkarpSkarp

Chapter 20 of 21

Prioritization, Decision Modeling, and Solution Evaluation

When you can’t build everything, you must decide what matters most—learn how to prioritize requirements, model decisions, and evaluate whether solutions actually delivered value.

27 min readen

Why Prioritization and Evaluation Matter for CAPM Projects

The Real Constraint

Projects rarely have enough time, budget, or people to build every requested feature. You must help decide what to do first, what to delay, and how to prove the solution worked.

Three Skill Sets

This module links three skills: prioritization of requirements, decision modeling to structure choices, and solution evaluation to test whether value was actually delivered.

CAPM Connection

These skills sit mainly in the Business Analysis Frameworks domain but also support Project Management Fundamentals. They build on your earlier work with requirements and process models.

What You Will Practice

You will practice MoSCoW prioritization, decision tables, cause-and-effect diagrams, defining metrics, segmented evaluations, and clear stakeholder communications.

MoSCoW and Other Prioritization Techniques

MoSCoW Categories

MoSCoW splits requirements into Must-have, Should-have, Could-have, and Won't-have (this time). It forces explicit trade-offs instead of vague "high/low" labels.

Must vs Should

Must-have means the solution fails without it. Should-have is very important, but a workaround exists. Exam questions often hide Shoulds disguised as Musts.

Could and Won't

Could-have features are nice enhancements. Won't-have items are explicitly out of this release but documented, reducing future conflict and scope creep.

Other Techniques

You may also see simple ranking, release-based grouping, and value vs effort grids. These complement MoSCoW when refining the product backlog.

Worked Example: Prioritizing a Registration System with MoSCoW

Scenario Setup

You are improving a university course registration system. Six features are proposed: payment, seat view, dark mode, waitlist, calendar export, and two-factor authentication.

Align with Objectives

The main objective is to cut help-desk calls by 40%. Constraints include payment security standards and university security policies. These guide what is truly critical.

Classifying Must-haves

Online payment, real-time seat view, and two-factor authentication are Must-haves: they support revenue, reduce calls, or satisfy security policy.

Shoulds and Coulds

Automatic waitlist is a Should-have with a manual workaround. Calendar export and dark mode are Could-haves: they improve comfort but not objectives or compliance.

Decision Modeling: Gateways, Decision Tables, and Root Cause Tools

Why Model Decisions?

Decision modeling makes messy choices visible. It shows branching logic, complex rules, and underlying causes so that teams can analyze and test them.

Decision Gateways

Gateways in process models show where flow splits based on conditions. Each path should represent a clear, testable outcome, like payment approved vs declined.

Decision Tables

Decision tables list conditions and outcomes in a grid. They are ideal when many rule combinations exist and you want to avoid gaps or contradictions.

Root Cause Tools

Cause-and-effect diagrams and 5 Whys are used for root cause analysis. They help move from visible symptoms to deeper process, people, or technology causes.

Example: Building a Decision Table and Fishbone Diagram

Conditions and Actions

For registration rules, define conditions like GPA, course level, and prerequisites. Define actions like self-register, advisor approval, or block registration.

Decision Table Rules

List each rule as a combination of Y/N conditions leading to an action. Check that all realistic combinations of GPA, course level, and prerequisites are covered.

Finding Gaps

Review the table to ensure no missing or conflicting rules. This helps both developers and testers implement and validate the logic correctly.

Fishbone for Errors

For many registration errors, your fishbone might include People, Process, Technology, and Policy branches, each listing likely contributing causes.

Defining Pre- and Post-Implementation Metrics

Why Metrics?

To know if a solution worked, you need measurable evidence. That means defining metrics, capturing a baseline, and comparing results after implementation.

Align with Goals

Metrics must align with objectives. If your goal is fewer help-desk calls, track call volume and duration, not just page views or logins.

Define and Baseline

Give each metric a name, unit, scope, and data source. Then capture pre-implementation values so you can later compare against them.

Compare and Interpret

After go-live, measure again and compare. Improvements suggest value, but also watch for side effects like new bottlenecks or user drop-offs.

Segmented Solution Evaluation and Workarounds

Why Segment?

Different stakeholder groups experience the same solution differently. Segmenting evaluation reveals whether all key groups are actually benefiting.

Examples of Segments

You might compare new vs returning students, domestic vs international, or front-line staff vs managers, each with their own metrics and concerns.

Workarounds and Bypasses

When users avoid the official process, they are signaling pain. Workarounds often reveal gaps in process, policy, training, or technology.

Diagnose, Don't Blame

Instead of blaming users, analyze why they bypassed workflows and recommend changes to steps, rules, training, or system design.

Communicating Evaluation Results to Stakeholders

Audience First

Executives, front-line staff, and technical teams need different views. Tailor depth, language, and visuals to each group’s interests and decision authority.

Useful Formats

Use process diagrams to show workflows, prototypes to show screens, and executive summaries to present objectives, metrics, findings, and recommendations.

Make It Clear

Use plain language, highlight before vs after metrics, and state what decision or action is needed. Avoid drowning stakeholders in raw data.

Feedback Loops

Check understanding by asking stakeholders to paraphrase or react. Their questions often reveal misunderstandings you can fix early.

Thought Exercise: From Vague Requirement to Testable Metric

Try this short exercise to practice turning vague statements into measurable evaluation criteria.

Scenario

A stakeholder says: "The new registration system should be much faster and less confusing for students."

Your tasks

  1. Rewrite this as two separate, testable requirements (one for speed, one for usability/clarity).
  2. For each requirement, propose one metric you would measure before and after implementation.
  3. Decide which stakeholder segments you would collect data from.

Pause and write your answers before revealing the sample solution.

---

Sample approach (compare to your answer)

  1. Testable requirements:
  • Speed: "The system shall allow a typical undergraduate student to complete course registration in under 8 minutes during peak hours."
  • Usability: "At least 80% of surveyed students shall rate the registration process as 'easy' or 'very easy' one month after launch."
  1. Metrics:
  • Speed metric: Average completion time (minutes) from login to confirmation during the first week of registration.
  • Usability metric: Percentage of students selecting 'easy' or 'very easy' on a post-registration survey.
  1. Segments:
  • New vs. returning students (new students may find it more confusing).
  • Domestic vs. international students (language and policy differences).

On the exam, similar items test whether you can convert vague desires into measurable criteria and link them to specific metrics and stakeholder groups.

Quiz 1: Prioritization and Decision Modeling

Answer this CAPM-style question to check your understanding of MoSCoW and decision tools.

A team is overwhelmed by 60 proposed features for a new internal portal. Budget and time allow only about half to be delivered in the first release. Some features are legally required, while others are convenience improvements. The project manager asks you to recommend an approach that both clarifies trade-offs and ensures compliance items are not missed. What is the BEST next step?

  1. Ask each stakeholder to rank their top 10 features and implement the most frequently mentioned ones.
  2. Apply MoSCoW prioritization with stakeholders, explicitly classifying requirements as Must-have, Should-have, Could-have, or Won't-have, and verifying that all legal and compliance items are in the Must-have group.
  3. Create a fishbone diagram of all requested features to identify root causes and then select only those that address the main causes.
  4. Use a decision table to list all 60 features and mark which stakeholder requested each, then prioritize features requested by the most stakeholders.
Show Answer

Answer: B) Apply MoSCoW prioritization with stakeholders, explicitly classifying requirements as Must-have, Should-have, Could-have, or Won't-have, and verifying that all legal and compliance items are in the Must-have group.

MoSCoW is designed to categorize requirements into Must-have, Should-have, Could-have, and Won't-have, making trade-offs explicit. It is especially useful when you must limit scope but cannot miss compliance-related Must-haves. Ranking by popularity or requester count can overlook legal requirements, and fishbone diagrams are for root cause analysis, not prioritizing a feature list.

Quiz 2: Solution Evaluation and Workarounds

Check your understanding of metrics and segmented evaluation.

After a new registration system goes live, overall help-desk calls drop by 45%, but calls from international students increase by 20%. Staff also begin manually enrolling many international students using a back-end tool instead of the official front-end workflow. As a CAPM-level practitioner, what should you do FIRST?

  1. Recommend turning off the back-end tool so staff are forced to use the new workflow as designed.
  2. Conclude that the project is a success because total calls decreased and prepare the final report.
  3. Conduct segmented solution evaluation focused on international students and investigate why staff are using the workaround, examining process, policy, training, and technology factors.
  4. Ask the development team to immediately add more servers to improve system performance for all users.
Show Answer

Answer: C) Conduct segmented solution evaluation focused on international students and investigate why staff are using the workaround, examining process, policy, training, and technology factors.

The key issue is that one stakeholder segment (international students) is experiencing problems that lead to workarounds. The appropriate first step is segmented solution evaluation and root cause investigation across process, policy, training, and technology. Disabling the workaround or declaring success ignores these issues, and adding servers may not address usability or policy problems.

Key Term Review: Prioritization, Decisions, and Evaluation

Flip these cards to reinforce core concepts that commonly appear on CAPM questions.

MoSCoW prioritization
A technique that categorizes requirements into Must-have, Should-have, Could-have, and Won't-have (this time), helping stakeholders make explicit trade-offs under constraints.
Decision gateway
A point in a process model where the flow branches based on conditions (e.g., yes/no, approved/rejected), representing different possible paths and outcomes.
Decision table
A structured grid that lists conditions and corresponding actions or outcomes, used to analyze and implement complex business rules and ensure all combinations are covered.
Cause-and-effect (fishbone) diagram
A root cause analysis tool that starts with a problem and visually organizes possible causes into categories such as People, Process, Technology, Policy, and Environment.
Pre-implementation metric (baseline)
A measurement taken before a solution is implemented, used as a reference point to compare with post-implementation results and determine whether value was delivered.
Segmented solution evaluation
Assessing solution performance separately for different stakeholder groups or user segments to see whether each group’s needs are met and to uncover hidden issues.
Workaround
An unofficial or alternative method that users adopt to bypass part of the designed process or system, often signaling problems with process, policy, training, or technology.
Executive summary (in evaluation)
A concise, high-level communication that presents objectives, key metrics, major findings, and recommended actions in plain language for decision makers.
Root cause analysis (RCA)
A set of techniques, such as 5 Whys and fishbone diagrams, used to identify the underlying causes of a problem rather than just treating its symptoms.
Product backlog
An ordered list of everything that is known to be needed in the product, managed by the product owner.

Key Terms

Workaround
An informal or temporary method used to complete work when the official process or system is difficult, slow, or unusable.
Decision table
A tabular representation of conditions and resulting actions used to define and analyze complex business rules.
Baseline metric
A measurement of performance taken before a change, used as a reference point to evaluate the impact of a solution.
Product backlog
An ordered list of everything that is known to be needed in the product, managed by the product owner.
Decision gateway
A branching point in a process model where different paths are taken based on defined conditions.
Executive summary
A brief, high-level overview of an analysis or report tailored for decision makers, focusing on key findings and recommendations.
Root cause analysis
An approach that seeks to identify the fundamental causes of a problem so that effective solutions can be implemented.
MoSCoW prioritization
A technique that categorizes requirements into Must-have, Should-have, Could-have, and Won't-have (this time) to support explicit trade-offs.
Cause-and-effect diagram
Also called a fishbone or Ishikawa diagram, a visual tool for organizing possible causes of a problem into logical categories.
Segmented solution evaluation
Evaluation of solution performance by distinct stakeholder or user groups to identify differences in outcomes or issues.

Finished reading?

Test your understanding with a custom practice exam on this chapter.

Test yourself