Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Expand
titleGoals

What does success look like? What metrics do we measure today that we can affect? What metrics should we absolutely add? Why it is important to affect those metrics?

Goal

Metric

Why Important?

Reliably extract citations from Authority Documents

When AI is not needed, 100% accuracy.

When AI is utilized, greater than 80% accuracy where 20% of Citations need to be reworked (e.g., split, merged, rejected …)

If there is poor accuracy requiring extensive human correction, then there is little value.

Reliably extract glossaries from Authority Documents

When AI is not needed, 100% accuracy.

When AI is utilized, greater than 95% 80% accuracy where only 5% 20% of term-definition pairs need to be reworked. Glossaries are substantially easier to identify and extract than citations.

If there is poor accuracy requiring extensive human correction, then there is little value.

Reliably automate the end-to-end process of capturing, transforming, and loading STIG, NIST 800-53, FedRAMP, eCFR compliance content into the Unified Compliance platform.

100% of identified Authority Documents for all four compliance content contributor sources is loaded into the UCF.

All four Authority Documents sources are related to securing and hardening IT infrastructure for both the private and public sector.

To provide value to customers with Security Operation's requirements, UC needs to maximize the breadth of security coverage to ensure we can provide security guidance for as many IT assets as possible.

Ingested compliance content, including Authority Documents, Citations, and Glossaries, are available for access via the UC 4.0 API Gateway

100% of identified Authority Documents for all four compliance content contributor sources are available for access via the UCF 4.0 API Gateway

We are in the migration phase from CCH to UC 4.0. To ensure we don’t elongate the migration process, all new content must come into UC 4.0 and out the API Gateway.

Reliably catalog Authority Documents, track versions, and detect changes

100% of all identified Authority Documents from the four (4) source sites are automatically cataloged with 0 documents moving further into the pipeline if no metadata changes are detected.

Before context is extracted, the Authority Documents must be inventoried, cataloged, and only reprocessed if changes are detected to reduce expensive AI processing resources.

Scope and Features

Expand
titlereadme

The section focusses on the details of the solution including what is in scope, what is out of scope and additional information to help in the product and engineering collaboration process.

...

Expand
titleadditional references

List and link to any other reference sites, documents … that might be important to the reader including the business model canvas (BMC).


STIG Overview

STIG Document Library

NIST SP 800-53 Overview

NIST GitHub Repository

FedRAMP Basics

FedRAMP GitHub Repository

eCFR Overview

eCFR Developer Resources

eCFR XML User Guide

eCFR API Documentation