Test Overview¶
This page provides an overview of all tests. Click on the test name to see the detailed results.
Test | Name | Provider | Model | Dataclass | Temperature | Role Description | Prompt File | Legacy Test |
---|---|---|---|---|---|---|---|---|
T01 | test_benchmark | openai | gpt-4o | false | ||||
T02 | test_benchmark | genai | gemini-2.0-flash | false | ||||
T03 | test_benchmark | anthropic | claude-3-5-sonnet-20241022 | false | ||||
T04 | test_benchmark2 | openai | gpt-4o | 0.5 | You are a Historian | a_prompt.txt | false | |
T05 | test_benchmark2 | genai | gemini-2.0-flash | 0.5 | You are a Historian | a_prompt.txt | false | |
T06 | test_benchmark2 | anthropic | claude-3-5-sonnet-20241022 | 0.5 | You are a Historian | a_prompt.txt | false | |
T07 | bibliographic_data | openai | gpt-4o | Document | 0.0 | You are a Historian | false | |
T08 | bibliographic_data | genai | gemini-2.0-flash | Document | 0.0 | You are a Historian | false | |
T09 | bibliographic_data | anthropic | claude-3-5-sonnet-20241022 | Document | 0.0 | You are a Historian | false | |
T10 | metadata_extraction | openai | gpt-4o | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T11 | metadata_extraction | openai | gpt-4.5-preview | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T12 | metadata_extraction | openai | gpt-4o-mini | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T13 | metadata_extraction | genai | gemini-2.0-flash | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T14 | metadata_extraction | genai | gemini-exp-1206 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T15 | metadata_extraction | genai | gemini-1.5-flash | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T16 | metadata_extraction | genai | gemini-1.5-pro | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T17 | metadata_extraction | anthropic | claude-3-7-sonnet-20250219 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T18 | metadata_extraction | anthropic | claude-3-5-sonnet-20241022 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T19 | metadata_extraction | genai | gemini-2.5-pro-exp-03-25 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T20 | metadata_extraction | genai | gemini-2.0-flash-lite | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T21 | metadata_extraction | genai | gemini-2.0-pro-exp-02-05 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T22 | fraktur | genai | gemini-2.5-pro-exp-03-25 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T23 | metadata_extraction | mistral | pixtral-large-latest | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history. You only return valid JSON an no other text. | prompt.txt | false |
T24 | metadata_extraction | anthropic | claude-3-7-sonnet-20250219 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T25 | metadata_extraction | anthropic | claude-3-7-sonnet-20250219 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T26 | bibliographic_data | openai | gpt-4.5-preview | Document | 0.0 | You are a Historian | false | |
T27 | bibliographic_data | openai | gpt-4o-mini | Document | 0.0 | You are a Historian | false | |
T28 | bibliographic_data | genai | gemini-exp-1206 | Document | 0.0 | You are a Historian | false | |
T29 | bibliographic_data | genai | gemini-1.5-flash | Document | 0.0 | You are a Historian | false | |
T30 | bibliographic_data | genai | gemini-1.5-pro | Document | 0.0 | You are a Historian | false | |
T31 | bibliographic_data | anthropic | claude-3-7-sonnet-20250219 | Document | 0.0 | You are a Historian | false | |
T32 | bibliographic_data | genai | gemini-2.5-pro-exp-03-25 | Document | 0.0 | You are a Historian | false | |
T33 | bibliographic_data | genai | gemini-2.0-flash-lite | Document | 0.0 | You are a Historian | false | |
T34 | bibliographic_data | genai | gemini-2.0-pro-exp-02-05 | Document | 0.0 | You are a Historian | false | |
T35 | bibliographic_data | mistral | pixtral-large-latest | Document | 0.0 | You are a Historian | false | |
T36 | metadata_extraction | anthropic | claude-3-opus-20240229 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T37 | metadata_extraction | anthropic | claude-3-5-haiku-20241022 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | true |
T38 | metadata_extraction | openai | gpt-4o | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T39 | metadata_extraction | openai | gpt-4o | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T40 | metadata_extraction | openai | gpt-4.5-preview | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T41 | metadata_extraction | openai | gpt-4.5-preview | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T42 | metadata_extraction | openai | gpt-4o-mini | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T43 | metadata_extraction | openai | gpt-4o-mini | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T44 | metadata_extraction | genai | gemini-2.0-flash | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T45 | metadata_extraction | genai | gemini-2.0-flash | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T46 | metadata_extraction | genai | gemini-exp-1206 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T47 | metadata_extraction | genai | gemini-exp-1206 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T48 | metadata_extraction | genai | gemini-1.5-flash | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T49 | metadata_extraction | genai | gemini-1.5-flash | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T50 | metadata_extraction | genai | gemini-1.5-pro | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T51 | metadata_extraction | genai | gemini-1.5-pro | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T52 | metadata_extraction | anthropic | claude-3-5-sonnet-20241022 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T53 | metadata_extraction | anthropic | claude-3-5-sonnet-20241022 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T54 | metadata_extraction | genai | gemini-2.5-pro-exp-03-25 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T55 | metadata_extraction | genai | gemini-2.5-pro-exp-03-25 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T56 | metadata_extraction | genai | gemini-2.0-flash-lite | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T57 | metadata_extraction | genai | gemini-2.0-flash-lite | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T58 | metadata_extraction | genai | gemini-2.0-pro-exp-02-05 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T59 | metadata_extraction | genai | gemini-2.0-pro-exp-02-05 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T60 | metadata_extraction | mistral | pixtral-large-latest | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history. You only return valid JSON an no other text. | prompt.txt | false |
T61 | metadata_extraction | mistral | pixtral-large-latest | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history. You only return valid JSON an no other text. | prompt.txt | false |
T62 | metadata_extraction | anthropic | claude-3-opus-20240229 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T63 | metadata_extraction | anthropic | claude-3-opus-20240229 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T64 | metadata_extraction | anthropic | claude-3-5-haiku-20241022 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | true |
T65 | metadata_extraction | anthropic | claude-3-5-haiku-20241022 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | true |
T66 | zettelkatalog | openai | gpt-4o | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T67 | metadata_extraction | openai | gpt-4.1 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T68 | metadata_extraction | openai | gpt-4.1 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T69 | metadata_extraction | openai | gpt-4.1 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T70 | metadata_extraction | openai | gpt-4.1-mini | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T71 | metadata_extraction | openai | gpt-4.1-mini | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T72 | metadata_extraction | openai | gpt-4.1-mini | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T73 | metadata_extraction | openai | gpt-4.1-nano | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T74 | metadata_extraction | openai | gpt-4.1-nano | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T75 | metadata_extraction | openai | gpt-4.1-nano | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T76 | metadata_extraction | openai | gpt-4o-mini | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T77 | metadata_extraction | openai | gpt-4o-mini | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T78 | metadata_extraction | openai | gpt-4o-mini | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T79 | fraktur | openai | gpt-4o | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T80 | fraktur | genai | gemini-2.5-pro-exp-03-25 | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T81 | fraktur | openai | gpt-4.5-preview | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T82 | fraktur | openai | gpt-4o-mini | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T83 | fraktur | openai | gpt-4.1 | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T84 | fraktur | openai | gpt-4.1-mini | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T85 | fraktur | openai | gpt-4.1-nano | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T86 | fraktur | genai | gemini-2.0-flash | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T87 | fraktur | genai | gemini-exp-1206 | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T88 | fraktur | genai | gemini-1.5-flash | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T89 | fraktur | genai | gemini-1.5-pro | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T90 | fraktur | genai | gemini-2.0-flash-lite | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T91 | fraktur | genai | gemini-2.0-pro-exp-02-05 | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T92 | fraktur | anthropic | claude-3-7-sonnet-20250219 | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T93 | fraktur | anthropic | claude-3-5-sonnet-20241022 | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T94 | fraktur | anthropic | claude-3-opus-20240229 | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T95 | fraktur | mistral | pixtral-large-latest | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T96 | fraktur | genai | gemini-2.5-flash-preview-04-17 | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T97 | fraktur | genai | gemini-2.5-pro-preview-05-06 | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T98 | fraktur | anthropic | claude-opus-4-20250514 | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T99 | fraktur | anthropic | claude-sonnet-4-20250514 | Document | 0.0 | You are a historian with keyword knowledge | prompt_optimized.txt | false |
T100 | metadata_extraction | anthropic | claude-opus-4-20250514 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T101 | metadata_extraction | anthropic | claude-opus-4-20250514 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T102 | metadata_extraction | anthropic | claude-opus-4-20250514 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T103 | metadata_extraction | anthropic | claude-sonnet-4-20250514 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T104 | metadata_extraction | anthropic | claude-sonnet-4-20250514 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T105 | metadata_extraction | anthropic | claude-sonnet-4-20250514 | Document | 0.0 | You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history | prompt.txt | false |
T106 | bibliographic_data | anthropic | claude-opus-4-20250514 | Document | 0.0 | You are a Historian | false | |
T107 | bibliographic_data | anthropic | claude-sonnet-4-20250514 | Document | 0.0 | You are a Historian | false |