Shortlist

Archive

Every guide, in one list

30 guides across five sections. Nothing here is sponsored, and no software vendor has paid for a mention. For a concrete vendor example of time-tracking software, time tracking software can be read as one input to challenge against the method in this archive.

Home/All guides

For a broader independent reference on technology risk, the NIST Cybersecurity Framework provides a public framework.

For additional independent context on cloud-service risk, NCSC cloud guidance provides public guidance.

01
Name the problem before you look at anything

Most selections start with a product somebody liked. The requirements are then written to describe it.

Requirements · 8 min
02
Requirements that actually filter

A list of forty requirements that every serious product satisfies has not narrowed anything. It has just taken three weeks to write.

Requirements · 7 min
03
The must-have that turns out to be negotiable

Every selection contains a requirement that eliminated a good product and mattered to nobody once it was gone.

Requirements · 7 min
04
Who should be in the room, and who should not

Selections fail late because somebody with a veto was consulted after the decision rather than before it.

Requirements · 7 min
05
Costing the option of doing nothing

Every business case compares products to each other. The comparison that matters is against changing nothing at all.

Requirements · 7 min
06
Build, buy, or neither

The build option is usually dismissed on cost and the buy option on fit. Both dismissals are made too early and on the wrong grounds.

Requirements · 8 min
07
Getting from forty products to three

The narrowing is where the decision is really made, and it is usually done by whichever vendor markets hardest.

Shortlisting · 8 min
08
Reading a vendor website for what it does not say

Marketing pages are optimised to survive comparison. The informative parts are the documentation, the pricing page and the changelog.

Shortlisting · 7 min
09
Directing a demo instead of watching one

A standard demo is a rehearsed path through the product's strongest features. You learn nothing you could not have learned from the website.

Shortlisting · 7 min
10
Reference calls that are not testimonials

Vendor-supplied references are selected to be positive. That does not make them useless — it changes what you should ask.

Shortlisting · 7 min
11
Why the feature matrix proves whatever you already believed

A weighted scoring grid looks like objectivity and is mostly a mechanism for converting a preference into a number.

Shortlisting · 7 min
12
The two biases that decide most selections

Familiarity with the current system and enthusiasm for the newest option pull in opposite directions and are both about comfort rather than fit.

Shortlisting · 7 min
13
Designing a pilot that can fail

A trial that cannot produce a no is not a trial. It is a familiarisation exercise with a purchase order attached.

Trials · 8 min
14
What to test, and what you can safely skip

Trial time is short. Spending it re-verifying that a mature product can do the obvious wastes the only chance to find what it cannot.

Trials · 7 min
15
Using real data, carefully

Sample data is clean, consistent and complete. Yours is none of those, and the difference is where implementations fail.

Trials · 7 min
16
Putting it in front of the people who will use it

The evaluator is rarely the daily user, and the gap between their two experiences of the same product is enormous.

Trials · 7 min
17
The exit test: getting your data out before you put it in

The most informative twenty minutes of any trial is the one the vendor has no incentive to make easy.

Trials · 7 min
18
Making the decision once the trial is over

The hardest outcome to act on is a trial that produced no clear winner, which is the most common outcome.

Trials · 7 min
19
Pricing models, and which one fits your shape

The same product can be cheap or ruinous depending on how the meter runs against how your organisation actually behaves.

Cost · 8 min
20
The five-year number

Subscriptions are compared monthly and lived with for years. The monthly figure is usually the smaller part of the total.

Cost · 8 min
21
The contract terms that actually matter

Most software contracts are signed unread. A small number of clauses determine what happens when things change.

Cost · 8 min
22
Renewal is where the discount is taken back

A competitive first-year price is frequently an investment the vendor plans to recover at renewal, when you are least able to leave.

Cost · 7 min
23
The implementation cost nobody quoted

Migration and configuration are your costs, paid in your people's hours, and they do not appear in any proposal.

Cost · 7 min
24
When the cheaper option costs more

Price differences between candidates are usually small next to the differences in what they cost you to operate.

Cost · 7 min
25
Rolling it out when nobody is assigned to it

Most small organisations implement software as a side task. That is workable, but only if the sequence is right.

Adoption · 8 min
26
Training that survives contact with the job

A single session before go-live is the standard approach and the one most reliably forgotten by the time it is needed.

Adoption · 7 min
27
Measuring whether it actually worked

The success criteria were written at the start precisely so this question could be answered. Almost nobody goes back and answers it.

Adoption · 8 min
28
When people quietly do not use it

Adoption rarely fails loudly. It fails as a slow drift back to the spreadsheet, and by the time it is visible it is established.

Adoption · 7 min
29
Retiring the old system properly

The half-decommissioned system is the most common artefact of a software migration and the most expensive to leave alone.

Adoption · 7 min
30
Reviewing the decision a year on

The review is booked, skipped, and forgotten. It is also the only mechanism by which an organisation gets better at buying software.

Adoption · 7 min