CMS selection – death to the features matrix
Categorised under: Content management
Seth Gottlieb has written an article arguing against feature matrix in CMS selection. To quote:
Nothing looks more convincing than a score where one option has more points than another.
But, users don’t necessarily want to use a system just because it has the highest cumulative, weighted score. They want to use a system that helps them efficiently get their jobs done while introducing the fewest number of annoyances.
If the measurement of accuracy is the overall satisfaction with the solution, this method is extremely faulty.
I’m 100% in support of this piece. In our work on CMS selection, we keep scoring to a very simple level, and encourage discussion and debate amongst the evaluation team. A good selection process should help the organisation to learn more about their own requirements, and not just about potential solutions.