Skip to content

Test Report

This test has the following configuration:

data provider model dataclass temperature prompt_file active

Test Results

f1_macro f1_micro cost_summary 

Detailed Results

Result for letter01

View raw result from qwen/qwen3-vl-8b-thinking

Category Ground Truth Prediction TP FP FN
send_date 1926-02-16 1926-02-16 1 0 0
sender_persons Groschupf-Jaeger, Louis
Ritter-Dreier, Fritz
G. Rillen 0 1 2
receiver_persons Christ-Wackernagel, Paul Herrn Christ 1 0 0
Name Alternate Names
Groschupf-Jaeger, Louis Groschopf
Groschupf
Herr Groschupf
Herrn Groschupf
Ritter-Dreier, Fritz Fritz Ritter
Herr Fritz Ritter
Herr Ritter
Herrn Fritz Ritter
J.A. Ritter
J.A.Ritter
Ritter
Christ-Wackernagel, Paul Christ
Christ-Wackernagel
Herr Christ
Herr P. Christ
Herr P. Christ - Wackernagel
Herr Vice- präsident Christ
Herren Christ
Herrn Christ
Herrn P. Christ
Herrn P. Christ - Wackernagel
Herrn P. Christ-Wackernagel
Herrn Paul Christ
Herrn Vizepräsidenten Christ
P. Christ - Wackernagel
P. Christ-Wackernagel
Paul Christ
Paul Christ-Wackernagel

Rules

inferred_from_function: False

inferred_from_correspondence: False

skip_signatures: False

skip_non_signatures: True

Letter images

letter01_p1.jpg

letter01_p2.jpg

letter01_p3.jpg

Result for letter02

Model did not produce a valid response!

Result for letter03

Model did not produce a valid response!

Result for letter04

Model did not produce a valid response!

Result for letter07

Model did not produce a valid response!

Result for letter09

Model did not produce a valid response!

Result for letter13

Model did not produce a valid response!

Result for letter14

View raw result from qwen/qwen3-vl-8b-thinking

Category Ground Truth Prediction TP FP FN
send_date 1928-02-18 1928-02-18 1 0 0
sender_persons Groschupf-Jaeger, Louis
Ritter-Dreier, Fritz
Basler Rheinschiffahrt-Aktiengesellschaft 0 1 2
receiver_persons None Basler Personenschifffahrts-Gesellschaft 0 1 0
Name Alternate Names
Groschupf-Jaeger, Louis Groschopf
Groschupf
Herr Groschupf
Herrn Groschupf
Ritter-Dreier, Fritz Fritz Ritter
Herr Fritz Ritter
Herr Ritter
Herrn Fritz Ritter
J.A. Ritter
J.A.Ritter
Ritter

Rules

inferred_from_function: False

inferred_from_correspondence: False

skip_signatures: False

skip_non_signatures: True

Letter images

letter14_p1.jpg

letter14_p2.jpg

letter14_p3.jpg

letter14_p4.jpg

letter14_p5.jpg

letter14_p6.jpg

Result for letter17

Model did not produce a valid response!

Result for letter19

Model did not produce a valid response!

Result for letter22

View raw result from qwen/qwen3-vl-8b-thinking

Category Ground Truth Prediction TP FP FN
send_date 1928-04-02 1928-04-02 1 0 0
sender_persons Groschupf-Jaeger, Louis
Kachelhofer-Gerber, Frederick Charles
Gundolf
W. Mäckler
0 2 2
receiver_persons None Kur- und Verkehrverein, Rheinfelden 0 1 0
Name Alternate Names
Groschupf-Jaeger, Louis Groschopf
Groschupf
Herr Groschupf
Herrn Groschupf
Kachelhofer-Gerber, Frederick Charles None

Rules

inferred_from_function: False

inferred_from_correspondence: False

skip_signatures: False

skip_non_signatures: True

Letter images

letter22_p1.jpg

Result for letter23

View raw result from qwen/qwen3-vl-8b-thinking

Category Ground Truth Prediction TP FP FN
send_date 1928-04-03 1958-04-03 0 1 1
sender_persons Ritter-Dreier, Fritz
Groschupf-Jaeger, Louis
F. Müller
G. Ganser
0 2 2
receiver_persons None Basler Personenschiffahrtsgesellschaft 0 1 0
Name Alternate Names
Ritter-Dreier, Fritz Fritz Ritter
Herr Fritz Ritter
Herr Ritter
Herrn Fritz Ritter
J.A. Ritter
J.A.Ritter
Ritter
Groschupf-Jaeger, Louis Groschopf
Groschupf
Herr Groschupf
Herrn Groschupf

Rules

inferred_from_function: False

inferred_from_correspondence: False

skip_signatures: False

skip_non_signatures: True

Letter images

letter23_p1.jpg

letter23_p2.jpg

Result for letter25

Model did not produce a valid response!

Result for letter27

Model did not produce a valid response!

Result for letter29

Model did not produce a valid response!

Result for letter31

Model did not produce a valid response!

Result for letter34

Model did not produce a valid response!

Result for letter39

View raw result from qwen/qwen3-vl-8b-thinking

Category Ground Truth Prediction TP FP FN
send_date 1928-05-26 1928-05-26 1 0 0
sender_persons Speich, Rudolf Dr. Rud. Speich 0 1 1
receiver_persons Vischer-von Planta, Max Dr. Max Vischer 1 0 0
Name Alternate Names
Speich, Rudolf Dr. R. Speich
Dr. RUD. SPEICH
Herr Dr. Speich
Herrn Dr. Speich
Herrn Dr.R. Speich
Herrn Dr.Speich
Rud. Speich
Rudolf Thomas Speich-Jenny
Vischer-von Planta, Max Dr Max VISCHER
Dr. M. Vischer - von Planta
Dr. M. Vischer-von Planta
Dr. M. Vischer-von Planta
Dr. Max Fischer
Dr. Max Vischer
Dr. Vischer - von Planta
Dr.M. Vischer - von Planta
Herr Dr. M. Vischer-von Planta
Herr Dr. Max Vischer
Herr Dr. Vischer
Herr Dr.Vischer
Herrn Dr. Max Vischer
Herrn Dr. Vischer
Herrn Dr.Max Vischer
Herrn Präsident Dr. Max Vischer
Max Vischer
Max Vischer-von Planta
V.
Vischer
praesident vischer

Rules

inferred_from_function: False

inferred_from_correspondence: False

skip_signatures: False

skip_non_signatures: True

Letter images

letter39_p1.jpg

letter39_p2.jpg

Result for letter40

Model did not produce a valid response!

Result for letter42

Model did not produce a valid response!

Result for letter43

Model did not produce a valid response!

Result for letter45

Model did not produce a valid response!

Result for letter48

Model did not produce a valid response!

Result for letter50

Model did not produce a valid response!

Result for letter52

Model did not produce a valid response!

Result for letter53

Model did not produce a valid response!

Result for letter55

Model did not produce a valid response!

Result for letter57

Model did not produce a valid response!

Result for letter58

Model did not produce a valid response!

Result for letter60

Model did not produce a valid response!

Result for letter62

Model did not produce a valid response!

Result for letter64

Model did not produce a valid response!