How it works, and how it is measured

Cited memos

1. The question is matched to the company's sample documents by keyword.
2. A web search with grounding returns findings and the pages they came from.
3. The memo is written with every source numbered. Any claim whose source ids are not in that list is removed in code before you see it.

Commitment extraction: measured

A promise counts as found when the owner, the due date and the key words of the task all match the hand label. Recall is the share of labelled promises found. Precision is the share of extracted promises that are labelled.

Limits

• The evaluation set is 30 short synthetic emails written and labelled by the developer. The target in the plan is above 90% recall on 100 labelled emails; this set is smaller and easier than real mail, so treat the score as early.
• The demo does not connect to anyone's inbox. Connecting Gmail needs Google's app verification, which is not done.
• Promises are not auto-closed when fulfilled. Use Mark done.
• Outputs are model suggestions to verify. Not legal or financial advice.