Task Types¶
This section examines coverage and performance across task types in SEB. The task types categories are derived from the MTEB benchmark.
Performance across Tasks Types¶
The table show the performance across task types:
Coverage¶
The follows table give you and an overview of the coverage of the tasks:
| Across | · Danish | Norwegian Bokmål | Norwegian Nynorsk | Swedish | ||
|---|---|---|---|---|---|---|
| Formalization | Task | |||||
| Retrieval | Question answering | ✓ | ✓ | ✓ | ✓ | |
| article retrieval | ✓ | ✓ | ✓ | ✓ | ||
| bitext Mining | dialect pairing | ✓ | ✓ | ✓ | ✓ | |
| Classification | Political | ✓ | ✓ | ✓ | ||
| Language Identification | ✓ | ✓ | ✓ | ✓ | ✓ | |
| Linguistic Acceptability | ✓ | ✓ | ✓ | ✓ | ✓ | |
| Sentiment/Hate Speech | ✓ | ✓ | ✓ | ✓ | ||
| Dialog Systems | ✓ | ✓ | ✓ | ✓ | ✓ | |
| Clustering | Thematic Clustering | ✓ | ✓ | ✓ | ||
| Reranking | ||||||
| Pair Classification | ||||||
| STS |