References to good practices and opportunities were identified based on English-language dictionary definitions in combination with semantically-related terms and phrases commonly identified in the literature. For more information about our approach, please see our methodology.
The taxonomy of good practices and opportunities was compiled based on English-language dictionary synonyms and semantically-related terms relevant to the concepts of case studies, good practice, success and opportunity. Semantic searches were conducted on the existing corpus of documents to identify relevant terms to include within the filter (e.g. good practice, best in class, gold standard, best approach). This taxonomy was compiled focusing on the language chosen to describe and evaluate activities and policies within the text (e.g. the use of the phrase ‘successful’ or ‘good practice’), and does not reflect any external evaluation or judgment of their success or efficacy.
The taxonomy was adapted to match the 3 hierarchies required for the tool and additions were made to capture acronyms, synonyms, and other grammatical expressions of the concepts within the taxonomy. Learn more about our taxonomy methodology.
We measured the performance of this concept by manually labelling a test set and comparing the labels to annotations made by this method. We will continue to update this section as we improve our approach for detecting this concept.
Over time we will use these statistics to evaluate which concepts are better to detect using machine learning models vs linguistic rules.
| Precision | Recall | F1 | Support |
|---|---|---|---|
| 0.6 | 0.55 | 0.57 | 38 |