15 Completing Analogies
Language
Reasoning
Analogies
Vocabulary
Relationships
15.1 Description:
This task involves completing analogies in the form “A is to B as C is to ?” to evaluate the model’s ability to recognize relationships between pairs of words and apply them to new contexts.
15.2 Modality:
Text only
15.3 Examples:
15.3.1 Example 1:
Input:
Complete the analogy: Tree is to forest as brick is to ?Output:
Building
Explanation: A tree is a component of a forest, just as a brick is a component of a building.15.3.2 Example 2:
Input:
Complete the analogy: Pen is to writer as brush is to ?Output:
Painter
Explanation: A pen is the primary tool used by a writer, just as a brush is the primary tool used by a painter.