Open benchmarks for reading CMC and GMP documents.

CMCBench and CMCParse are designed to measure how systems read chemistry, manufacturing and controls (CMC) and good manufacturing practice (GMP) documents. IntelligenceQ initiated and specified both.

Drawing of two document pages, the values read from one boxed with their place on the page — Each value read from a page is boxed where it sits, so a reviewer can check it.

THE BENCHMARKS / 01

What each benchmark measures.

CMCBench

The values a system reads from a CMC document, and the evidence it gives for each.

Specification 2.0

CMCParse

How a system reads a page's text, tables and instrument traces.

Specification 2.0

Specification 2.0 came after three reviews. CMCBench and CMCParse mark systems affiliated with IntelligenceQ and exclude them from highlights. They do not qualify, validate or certify any system for any GMP or regulatory use.

CONTRIBUTORS

Help build the benchmarks.

Contribute documents, annotate, hold custody of the held-out split or submit a system.

Take part