Because of a lapse in government funding, the information on this website may not be up to date, transactions submitted via the website may not be processed, and the agency may not be able to respond to inquiries until appropriations are enacted. The NIH Clinical Center (the research hospital of NIH) is open. For more details about its operating status, please visit cc.nih.gov. Updates regarding government operating status and resumption of normal operations can be found at OPM.gov.
Example - Add SD-Rules from Other Suggestions
Other suggested SD-Rules can be evaluated and added to this system by following the same approach in the previous two sessions: nomD session and factD session.
Suggested SD-Rule | Notes | Examples | Status |
---|---|---|---|
$|verb|less$|adj | This rule should be evaluated first to complete suffix negation. |
| Evaluated: Bad SD-Rule |
$|adj|ly$|adv | Suggested by Lynn |
| Rejected - duplicated |
$|noun|y$|adj | Suggested by Lynn |
| Rejected - duplicated |
al$|adj|us$|noun | Suggested by Chris, seconded by Destinee & Lynn |
| TBD |
$|noun|ize$|verb | Suggested by Lynn |
| TBD |
e$|verb|ing$|noun | Suggested by Chris |
| TBD |
The iterative results are shown as follows:
ID | Suggested Candidate Rule | Total Yes | Total Rule No. | Rule No. | A. Rate | Occr. | Yes | No | Tbd | SD-Rule | Status | Source | Notes | Sys A. Rate | Sys C. Rate | Sys. Perf | Notes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2.3.4.5 (prev. optimized set) | 42,545 | 95 | 73 | 60.66% | 183 | 111 | 72 | 0 | ar$|adj|e$|noun | 2013 | ORG_RULE | SELF | 95.30% | 95.02% | 1.9033 | Baseline | |
2.3.4.5.1 |
101|1.84%|381|7|374|0|$|verb|less$|adj|2013|ORG_FACT|SELF
| 42,552 = 42,545 + 7 | 96 | 73 | 60.66% | 183 | 111 | 72 | 0 | ar$|adj|e$|noun | 2013 | ORG_RULE | SELF | 95.30% | 95.01% | 1.9031 | Worse |
The result shows the new selected SD-rule does not improve the system performance and should not be included in the optimized set. However, this SD-rule is added to the SD-rules evaluation set to cover more evaluated SD-rules. The new optimized set has coverage rate (95.01%) and system performance (1.9031) with accuracy rate of 95.30% to include 73 (out of 96) SD-rules. This set should be used as baseline for evaluating new rules in the future. The diagram below shows the system accuracy and coverage curves of this optimized set.