Goal | Metric | Why Important? |
---|
Reliably extract citations from Authority Documents | When AI is not needed, 100% accuracy. When AI is utilized, greater than 80% accuracy where 20% of Citations need to be reworked (e.g., split, merged, rejected …) | If there is poor accuracy requiring extensive human correction, then there is little value. |
Reliably extract glossaries from Authority Documents | When AI is not needed, 100% accuracy. When AI is utilized, greater than 95% 80% accuracy where only 5% 20% of term-definition pairs need to be reworked. Glossaries are substantially easier to identify and extract than citations. | If there is poor accuracy requiring extensive human correction, then there is little value. |
Reliably automate the end-to-end process of capturing, transforming, and loading STIG, NIST 800-53, FedRAMP, eCFR compliance content into the Unified Compliance platform. | 100% of identified Authority Documents for all four compliance content contributor sources is loaded into the UCF. | All four Authority Documents sources are related to securing and hardening IT infrastructure for both the private and public sector. To provide value to customers with Security Operation's requirements, UC needs to maximize the breadth of security coverage to ensure we can provide security guidance for as many IT assets as possible. |
Ingested compliance content, including Authority Documents, Citations, and Glossaries, are available for access via the UC 4.0 API Gateway | 100% of identified Authority Documents for all four compliance content contributor sources are available for access via the UCF 4.0 API Gateway | We are in the migration phase from CCH to UC 4.0. To ensure we don’t elongate the migration process, all new content must come into UC 4.0 and out the API Gateway. |
Reliably catalog Authority Documents, track versions, and detect changes | 100% of all identified Authority Documents from the four (4) source sites are automatically cataloged with 0 documents moving further into the pipeline if no metadata changes are detected. | Before context is extracted, the Authority Documents must be inventoried, cataloged, and only reprocessed if changes are detected to reduce expensive AI processing resources. |