Earlier this month, I spoke with James H. Dobbins about his latest book, Critical Success Factors: How to Effectively Identify, Measure, and Apply CSFs, which equips managers with a practical framework to accurately identify, measure, and apply their critical success factors (CSFs). Unlike previous efforts that relied on broad surveys and statistical analyses intended to generate generalized lists of CSFs, this approach honors the foundational definition of CSFs and provides actionable guidance tailored to each manager’s unique context.
During our conversation, I asked James, "What are the biggest mistakes managers make when trying to measure critical success factors (CSFs)?" Here is his complete answer:
The biggest mistake managers make when trying to measure critical success factors (CSFs) is failing to understand what CSFs are in the first place. Managers turn to the results of research by others, projects often done by academics in the pursuit of an advanced degree. The research objective is to produce a list of generalized CSFs. Once the list is published, the research is completed, the degree is granted, and the researcher goes on with their life. No measures are suggested. Many researchers worldwide, all with the same objective, have published different sets of CSFs. There is no guidance on which list to use. The biggest problem is that all the research was conducted using surveys of large numbers of managers, and there has never been a valid list of CSFs produced from surveys. Using surveys to identify CSFs has several fundamental flaws. Some, noted in the Introduction to the book, are:
- The assumption that project managers know how to identify their CSFs,
- The failure to recognize that CSFs are contextually relevant to the manager, and therefore, the elimination of anything not generalizable, is contrary to the definition of CSF.
- The failure to understand that Critical Success Factors are, in fact, critical for a specific manager, and that all must be done well. CSFs are not something you pick from a menu, like a survey result, hoping you chose the right ones.
- The absence of any longitudinal studies. There was no follow-up with any of the managers surveyed to validate the study's results or to determine whether and how they utilized the CSFs identified in the survey.
- There was no attempt to identify measures for the identified CSFs to help managers track their success in meeting the CSFs.
