Piloting an automated clinical trial eligibility surveillance and provider alert system based on artificial intelligence and standard data models

Table 2 Accuracy of information extraction

	Annotations in the reference	True positive	False positive	False negative	Recall	Precision	F₁-measure
Disease/Condition	270	136	207	134	0.504	0.397	0.444
Investigation name	194	108	72	86	0.557	0.600	0.578
Investigation result value	167	70	6	97	0.419	0.921	0.576
Medication	200	191	36	99	0.659	0.841	0.739
Procedure	75	3	0	72	0.040	1.000	0.077
Age	22	16	0	6	0.727	1.000	0.842
Gender	18	14	3	4	0.778	0.824	0.800
Device	10	0	0	10	0.000	0.000	0.000
Micro-average					0.514	0.624	0.564
Macro-average					0.409	0.798	0.579

ISSN: 1471-2288