...
Development Roadmap
Next steps would entail:
...
Over a period 0f 4-6 months: Going from a proof-of-concept to a production-ready platform:
Proposed way forward:
Refinement of Retrieval Mechanism: Enhance the AI's ability to accurately source and retrieve relevant data.
Re-visit Architecture
Evaluate vectorstores (Vectorstore/Knowledge Graph)
Set up Semantic Retrieval
Enrichment of Sources: Expand and diversify the data sources to improve the tool's comprehensiveness.
Fine-Tuning for Quality: Optimize the AI algorithms to ensure high-quality, accurate compliance term generation.
Set up evaluation RAG Triad with set of evaluation questions
Iterate with:
Re-rank,
Sentence-window and
Auto-merging Retrieval
Self-evaluation by LLM
...
Milestone after 3 months: Internal Beta Roll-out:
POC to Production in AWS: Transition the Proof of Concept (POC) into a full-scale production environment on AWS.
Integration with Mapper Team: Provide the tool to the mapper team for human validation, ensuring accuracy and reliability.
...
Milestone after 4-5 months: External Beta Roll-out:
Following successful internal use and quality benchmarks, release the tool externally as a feature of the Dictionary solution.
...