Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Expand
titleGoals

What does success look like? What metrics do we measure today that we can we effect and why affect? What metrics should we absolutely add? Why it is important to affect those metrics?

Goal

Metric

Why Important?

Reliably extract citations from Authority Documents

>= 80% accuracy where 20% of Citations need to be reworked (e.g., split, merged, rejected …)

If there is poor accuracy requiring extensive human correction, then there is little value.

Reliably extract glossaries from Authority Documents

>= 95% accuracy where only 5% of term-definition pairs need to be reworked. Glossaries are substantially easier to identify and extract than citations.

If there is poor accuracy requiring extensive human correction, then there is little value.

Reliably automate the end-to-end process of capturing, transforming, and loading STIG, NIST 800-53, FedRAMP, eCFR compliance content into the Unified Compliance platform.

100% of identified Authority Documents for all four compliance content contributor sources is loaded into the UCF.

All four Authority Documents sources are related to securing and hardening IT infrastructure for both the private and public sector.

To provide value to customers with Security Operation's requirements, UC needs to maximize the breadth of security coverage to ensure we can provide security guidance for as many IT assets as possible.

...

Expand
titleFeatures

Describe the product features that will bring value to customers and fulfill underserved need(s).

Feature

Use Case / Problem Solved

Automatic Citation and Glossary Extraction from Authority Documents

Out of all the ancillary information found in Authority Documents, specific passages containing Mandates (requirements) and related contextual information such as stubs, informational, and informational gathering are extracted from the Authority Documents.

Human-in-the-loop Training for Content Extraction AI Models

Expert mappers can validate and make changes about the correctness of the AI-driven Citation and Glossary extraction helping train the AI model to produce increasingly better results.

Automated Compliance Content Ingestion into the Common Data Format

Authority Documents (initially targeted for STIGs, NIST 800-53, FedRAMP, and eCFR) are loaded into the UCF platform with minimal human intervention.

Monitoring and Logging

Administrators can make informed decisions and take action on the ingestion process based on meaningful information that is collected throughout compliance content ingestion process.

Metadata and Data Change Detection

Compliance professionals are kept to up to date with changes made by compliance content providers.

Statistical Data Capture and Reporting

Product and engineering teams can review statistical results captured during the document ingestion process to help make objective data-driven decisions about the accuracy and effectiveness off the process automation.

...

Expand
titleLaunch Readiness

Identify any relevant milestones that people should now know about. Will we “eat it” ourselves first? Will this require a beta? and what is the target launch date?

Date

Milestone

Audience

Description

TBD

Dogfood 🐶

Internal employees only.

Testing internally

TBD

Beta 🎈

Early cohort of X customers.

Getting user feedback

TBD

Public Launch 🚀

Roll-out to all users.

Let’s do it!

...