Because of a lapse in government funding, the information on this website may not be up to date, transactions submitted via the website may not be processed, and the agency may not be able to respond to inquiries until appropriations are enacted. The NIH Clinical Center (the research hospital of NIH) is open. For more details about its operating status, please visit cc.nih.gov. Updates regarding government operating status and resumption of normal operations can be found at OPM.gov.

Sub-Term Mapping Tools

All Terms with SMT synonyms lsit

The setup of thsi test are described as follows:

  • Input Terms: all terms from UMLS-Core:
    • Original ID|TERM|CUI: 15,447
    • Total term with multi-CUI: 35
    • Total term with multi-ID: 1,492
    • It has been modified to 13,077 input TERM|CUI.

  • SMT model:
    • Lexicon, 2013
    • Meta-thesaurus, 2013AA
    • Synonyms list: SMT 2013

Test IDSynonymslvg flowNo Sub.1 Sub.2 Sub.PrecisionRecallF1-measureMetaMap
Distance
Score
SMTSMT synonyms 78.23% (10,230)4.74% (620)0.31% (40)63.48%77.52%0.6980N/A
SMT_sSMT synonyms + s 78.23% (10,230)5.00% (654)0.34% (45)63.44%77.76%0.6987N/A
SMT_iSMT synonyms + i 78.23% (10,230)4.76% (623)0.31% (40)63.47%77.53%0.6980N/A
SMT_ySMT synonyms + y 78.23% (10,230)4.74% (620)0.31% (40)63.48%77.52%0.6980N/A
SMT_ASMT synonyms + A 78.23% (10,230)6.35% (830)0.63% (82)63.52%79.64%0.7067N/A
SMT_aSMT synonyms + a 78.23% (10,230)6.42% (840)0.68% (89)63.50%79.71%0.7069N/A
SMT_dSMT synonyms + d 78.23% (10,230)5.21% (681)0.42% (55)63.37%77.99%0.6992N/A
SMT_GeSMT synonyms + Ge 78.23% (10,230)7.33% (959)0.89% (117)62.63%80.65%0.7050N/A

  • Precision = relevant, retrieved / total retrieved
  • Recall = relevant, retrieved / total relevant
  • F1 = (2 x Precision x Recall) / (Precision + Recall)
    precision and recall are equally important, so use F1 (β = 1)