Skip to content

Test Report

This test has the following configuration:

data provider model dataclass temperature prompt_file active

Test Results

f1_macro f1_micro cost_summary 

Detailed Results

Result for letter01

View raw result from qwen/qwen3-vl-8b-thinking

Category Ground Truth Prediction TP FP FN
send_date 1926-02-16 1926-02-16 1 0 0
sender_persons Groschupf-Jaeger, Louis
Ritter-Dreier, Fritz
Dr. Rillen 0 1 2
receiver_persons Christ-Wackernagel, Paul Herrn Christ
Farovicini, Christ & Co.
1 1 0
Name Alternate Names
Groschupf-Jaeger, Louis Groschopf
Groschupf
Herr Groschupf
Herrn Groschupf
Ritter-Dreier, Fritz Fritz Ritter
Herr Fritz Ritter
Herr Ritter
Herrn Fritz Ritter
J.A. Ritter
J.A.Ritter
Ritter
Christ-Wackernagel, Paul Christ
Christ-Wackernagel
Herr Christ
Herr P. Christ
Herr P. Christ - Wackernagel
Herr Vice- präsident Christ
Herren Christ
Herrn Christ
Herrn P. Christ
Herrn P. Christ - Wackernagel
Herrn P. Christ-Wackernagel
Herrn Paul Christ
Herrn Vizepräsidenten Christ
P. Christ - Wackernagel
P. Christ-Wackernagel
Paul Christ
Paul Christ-Wackernagel

Rules

inferred_from_function: False

inferred_from_correspondence: False

Letter images

letter01_p1.jpg

letter01_p2.jpg

letter01_p3.jpg

Result for letter02

Model did not produce a valid response!

Result for letter03

Model did not produce a valid response!

Result for letter04

Model did not produce a valid response!

Result for letter05

Model did not produce a valid response!

Result for letter06

Model did not produce a valid response!

Result for letter07

Model did not produce a valid response!

Result for letter08

Model did not produce a valid response!

Result for letter09

Model did not produce a valid response!

Result for letter10

Model did not produce a valid response!

Result for letter11

Model did not produce a valid response!

Result for letter12

Model did not produce a valid response!

Result for letter13

Model did not produce a valid response!

Result for letter14

View raw result from qwen/qwen3-vl-8b-thinking

Category Ground Truth Prediction TP FP FN
send_date 1928-02-18 1928-02-18 1 0 0
sender_persons Groschupf-Jaeger, Louis
Ritter-Dreier, Fritz
Basler Rheinschiffahrt-Aktiengesellschaft 0 1 2
receiver_persons None Basler Personenschiffahrts-Gesellschaft 0 1 0
Name Alternate Names
Groschupf-Jaeger, Louis Groschopf
Groschupf
Herr Groschupf
Herrn Groschupf
Ritter-Dreier, Fritz Fritz Ritter
Herr Fritz Ritter
Herr Ritter
Herrn Fritz Ritter
J.A. Ritter
J.A.Ritter
Ritter

Rules

inferred_from_function: False

inferred_from_correspondence: False

Letter images

letter14_p1.jpg

letter14_p2.jpg

letter14_p3.jpg

letter14_p4.jpg

letter14_p5.jpg

letter14_p6.jpg

Result for letter15

Model did not produce a valid response!

Result for letter16

Model did not produce a valid response!

Result for letter17

View raw result from qwen/qwen3-vl-8b-thinking

Category Ground Truth Prediction TP FP FN
send_date 1928-03-01 1928-03-01 1 0 0
sender_persons Speich, Rudolf
Groschupf-Jaeger, Louis
Basler Rheinschiffahrt-Aktiengesellschaft 0 1 2
receiver_persons None Basler Personenschiffahrtsgesellschaft 0 1 0
Name Alternate Names
Speich, Rudolf Dr. R. Speich
Dr. RUD. SPEICH
Herr Dr. Speich
Herrn Dr. Speich
Herrn Dr.R. Speich
Herrn Dr.Speich
Rud. Speich
Rudolf Thomas Speich-Jenny
Groschupf-Jaeger, Louis Groschopf
Groschupf
Herr Groschupf
Herrn Groschupf

Rules

inferred_from_function: False

inferred_from_correspondence: False

Letter images

letter17_p1.jpg

letter17_p2.jpg

Result for letter18

Model did not produce a valid response!

Result for letter19

Model did not produce a valid response!

Result for letter20

Model did not produce a valid response!

Result for letter21

Model did not produce a valid response!

Result for letter22

Model did not produce a valid response!

Result for letter23

View raw result from qwen/qwen3-vl-8b-thinking

Category Ground Truth Prediction TP FP FN
send_date 1928-04-03 1958-04-03 0 1 1
sender_persons Ritter-Dreier, Fritz
Groschupf-Jaeger, Louis
Basler Rheinschifffahrt-Aktiengesellschaft 0 1 2
receiver_persons None Basler Personenschiffahrtsgesellschaft 0 1 0
Name Alternate Names
Ritter-Dreier, Fritz Fritz Ritter
Herr Fritz Ritter
Herr Ritter
Herrn Fritz Ritter
J.A. Ritter
J.A.Ritter
Ritter
Groschupf-Jaeger, Louis Groschopf
Groschupf
Herr Groschupf
Herrn Groschupf

Rules

inferred_from_function: False

inferred_from_correspondence: False

Letter images

letter23_p1.jpg

letter23_p2.jpg

Result for letter24

Model did not produce a valid response!

Result for letter25

Model did not produce a valid response!

Result for letter26

Model did not produce a valid response!

Result for letter27

Model did not produce a valid response!

Result for letter28

Model did not produce a valid response!

Result for letter29

Model did not produce a valid response!

Result for letter31

Model did not produce a valid response!

Result for letter32

Model did not produce a valid response!

Result for letter33

Model did not produce a valid response!

Result for letter34

Model did not produce a valid response!

Result for letter36

Model did not produce a valid response!

Result for letter38

Model did not produce a valid response!

Result for letter39

Model did not produce a valid response!

Result for letter40

View raw result from qwen/qwen3-vl-8b-thinking

Category Ground Truth Prediction TP FP FN
send_date 1928-05-29 1898-05-22 0 1 1
sender_persons Stauffacher, Werner J. M. H. 0 1 1
receiver_persons Vischer-von Planta, Max Dr. Max Vischer 1 0 0
Name Alternate Names
Stauffacher, Werner Direktor Werner Stauffacher
Herr Stauffacher
Herr Werner Stauffacher
Herren Stauffacher
Herrn Direktor Werner Stauffacher
Herrn W. Stauffacher
Stauffacher
W. Stauffacher
Werner Stauffacher
Vischer-von Planta, Max Dr Max VISCHER
Dr. M. Vischer - von Planta
Dr. M. Vischer-von Planta
Dr. M. Vischer-von Planta
Dr. Max Fischer
Dr. Max Vischer
Dr. Vischer - von Planta
Dr.M. Vischer - von Planta
Herr Dr. M. Vischer-von Planta
Herr Dr. Max Vischer
Herr Dr. Vischer
Herr Dr.Vischer
Herrn Dr. Max Vischer
Herrn Dr. Vischer
Herrn Dr.Max Vischer
Herrn Präsident Dr. Max Vischer
Max Vischer
Max Vischer-von Planta
V.
Vischer
praesident vischer

Rules

inferred_from_function: False

inferred_from_correspondence: False

Letter images

letter40_p1.jpg

letter40_p2.jpg

Result for letter42

Model did not produce a valid response!

Result for letter43

Model did not produce a valid response!

Result for letter45

Model did not produce a valid response!

Result for letter46

Model did not produce a valid response!

Result for letter48

Model did not produce a valid response!

Result for letter49

Model did not produce a valid response!

Result for letter50

Model did not produce a valid response!

Result for letter51

Model did not produce a valid response!

Result for letter52

Model did not produce a valid response!

Result for letter53

Model did not produce a valid response!

Result for letter55

Model did not produce a valid response!

Result for letter57

Model did not produce a valid response!

Result for letter58

Model did not produce a valid response!

Result for letter59

Model did not produce a valid response!

Result for letter60

Model did not produce a valid response!

Result for letter61

Model did not produce a valid response!

Result for letter62

Model did not produce a valid response!

Result for letter63

Model did not produce a valid response!

Result for letter64

Model did not produce a valid response!

Result for letter65

Model did not produce a valid response!