Unified MemoryBenchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Summarize + extract
summarize-extract-003
hard extractionreceipt
The prompt
user
Extract information from the receipt (OCR text from a photo) below. Reply with only a JSON object with exactly these keys:
- "merchant" (string): store name
- "date" (string "YYYY-MM-DD"): purchase date (correct obvious OCR errors)
- "time" (string "HH:MM" (24-hour)): purchase time (correct obvious OCR errors)
- "line_items" (array): array of products bought (not discounts), each {"description": string, "quantity": number, "line_total": number}
- "discount" (number): total discount amount as a positive number
- "total" (number): total amount
- "payment_method" (string): one of "cash", "credit", "debit", "other"
Rules: include every key listed. Use null for any field that is not stated in the text (do not guess). Dates are YYYY-MM-DD. Times are HH:MM in 24-hour format. Amounts and counts are plain JSON numbers (no currency symbols, no commas). Phone numbers are in international format with + and the country code, for example +1 312 555 0100; leave out any national trunk prefix 0, so (0)20 or 020 becomes 20 after +44.
Receipt (OCR text from a photo):
"""
HARBOR LINE HARDWARE
Since 1961 -- 77 Wharf Rd, Kittery ME
Store 03 Reg 2 Cashier: DEB
10/O9/2026 14:1l
2 @ 4.29
WOOD SCREWS #8 1-1/4" 8.58
PAINTERS TAPE 1.88IN 6.49
3 @ 1.l9
SANDPAPER 220 GR1T 3.57
DROP CL0TH 9X12 12.99
MEMBER DISC -2.00
SUBTOTAL 29.63
SALES TAX 5.5% 1.63
TOTAL 31.26
CASH 40.00
CHANGE 8.74
"""What we expected
{
"kind": "extract",
"answer": {
"merchant": "Harbor Line Hardware",
"date": "2026-10-09",
"time": "14:11",
"line_items": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"discount": 2,
"total": 31.26,
"payment_method": "cash"
},
"fields": {
"merchant": {
"type": "string"
},
"date": {
"type": "date"
},
"time": {
"type": "time"
},
"line_items": {
"type": "list",
"item_fields": {
"description": {
"type": "text",
"needles_map": {
"WOOD SCREWS #8 1-1/4\"": [
"screw"
],
"PAINTERS TAPE 1.88IN": [
"tape"
],
"SANDPAPER 220 GRIT": [
"sandpaper",
"sand paper"
],
"DROP CLOTH 9X12": [
"drop"
]
}
},
"quantity": {
"type": "number"
},
"line_total": {
"type": "number"
}
}
},
"discount": {
"type": "number"
},
"total": {
"type": "number"
},
"payment_method": {
"type": "enum"
}
}
}What each model answered
MiMo-V2.6 Distill 9B
✗ fail · score 86 · 6.70 s
{"merchant": "HARBOR LINE HARDWARE", "date": "2026-09-10", "time": "14:11", "line_items": [{"description": "WOOD SCREWS #8 1-1/4\"", "quantity": 2, "line_total": 8.58}, {"description": "PAINTERS TAPE 1.88IN", "quantity": 1, "line_total": 6.49}, {"description": "SANDPAPER 220 GR1T", "quantity": 3, "line_total": 3.57}, {"description": "DROP CL0TH 9X12", "quantity": 1, "line_total": 12.99}], "discount": 2, "total": 31.26, "payment_method": "cash"}Scoring detail
{
"fields": {
"merchant": {
"score": 1,
"expected": "Harbor Line Hardware",
"got": "HARBOR LINE HARDWARE"
},
"date": {
"score": 0,
"expected": "2026-10-09",
"got": "2026-09-10"
},
"time": {
"score": 1,
"expected": "14:11",
"got": "14:11"
},
"line_items": {
"score": 1,
"expected": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"got": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GR1T",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CL0TH 9X12",
"quantity": 1,
"line_total": 12.99
}
]
},
"discount": {
"score": 1,
"expected": 2,
"got": 2
},
"total": {
"score": 1,
"expected": 31.26,
"got": 31.26
},
"payment_method": {
"score": 1,
"expected": "cash",
"got": "cash"
}
},
"fields_correct": 6,
"fields_total": 7
}Ornith-1.5 9B
✓ pass · score 100 · 6.44 s
```json
{
"merchant": "HARBOR LINE HARDWARE",
"date": "2026-10-09",
"time": "14:11",
"line_items": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"discount": 2.0,
"total": 31.26,
"payment_method": "cash"
}
```Scoring detail
{
"fields": {
"merchant": {
"score": 1,
"expected": "Harbor Line Hardware",
"got": "HARBOR LINE HARDWARE"
},
"date": {
"score": 1,
"expected": "2026-10-09",
"got": "2026-10-09"
},
"time": {
"score": 1,
"expected": "14:11",
"got": "14:11"
},
"line_items": {
"score": 1,
"expected": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"got": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
]
},
"discount": {
"score": 1,
"expected": 2,
"got": 2
},
"total": {
"score": 1,
"expected": 31.26,
"got": 31.26
},
"payment_method": {
"score": 1,
"expected": "cash",
"got": "cash"
}
},
"fields_correct": 7,
"fields_total": 7
}Granite 4.2 8B
✓ pass · score 100 · 6.76 s
{
"merchant": "HARBOR LINE HARDWARE",
"date": "2026-10-09",
"time": "14:11",
"line_items": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CL0TH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"discount": 2.0,
"total": 31.26,
"payment_method": "cash"
}Scoring detail
{
"fields": {
"merchant": {
"score": 1,
"expected": "Harbor Line Hardware",
"got": "HARBOR LINE HARDWARE"
},
"date": {
"score": 1,
"expected": "2026-10-09",
"got": "2026-10-09"
},
"time": {
"score": 1,
"expected": "14:11",
"got": "14:11"
},
"line_items": {
"score": 1,
"expected": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"got": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CL0TH 9X12",
"quantity": 1,
"line_total": 12.99
}
]
},
"discount": {
"score": 1,
"expected": 2,
"got": 2
},
"total": {
"score": 1,
"expected": 31.26,
"got": 31.26
},
"payment_method": {
"score": 1,
"expected": "cash",
"got": "cash"
}
},
"fields_correct": 7,
"fields_total": 7
}Spark-X2.5 4B
✓ pass · score 100 · 5.20 s
{
"merchant": "HARBOR LINE HARDWARE",
"date": "2026-10-09",
"time": "14:11",
"line_items": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GR1T",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CL0TH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"discount": 2.0,
"total": 31.26,
"payment_method": "cash"
}Scoring detail
{
"fields": {
"merchant": {
"score": 1,
"expected": "Harbor Line Hardware",
"got": "HARBOR LINE HARDWARE"
},
"date": {
"score": 1,
"expected": "2026-10-09",
"got": "2026-10-09"
},
"time": {
"score": 1,
"expected": "14:11",
"got": "14:11"
},
"line_items": {
"score": 1,
"expected": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"got": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GR1T",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CL0TH 9X12",
"quantity": 1,
"line_total": 12.99
}
]
},
"discount": {
"score": 1,
"expected": 2,
"got": 2
},
"total": {
"score": 1,
"expected": 31.26,
"got": 31.26
},
"payment_method": {
"score": 1,
"expected": "cash",
"got": "cash"
}
},
"fields_correct": 7,
"fields_total": 7
}Mellum2.1 12B-A2.5B
✗ fail · score 89 · 3.11 s
{
"merchant": "HARBOR LINE HARDWARE",
"date": "2026-10-09",
"time": "14:11",
"line_items": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 4.29
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 3,
"line_total": 1.19
},
{
"description": "SANDPAPER 220 GR1T",
"quantity": 3,
"line_total": 1.97
},
{
"description": "DROP CL0TH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"discount": 2.00,
"total": 31.26,
"payment_method": "cash"
}Scoring detail
{
"fields": {
"merchant": {
"score": 1,
"expected": "Harbor Line Hardware",
"got": "HARBOR LINE HARDWARE"
},
"date": {
"score": 1,
"expected": "2026-10-09",
"got": "2026-10-09"
},
"time": {
"score": 1,
"expected": "14:11",
"got": "14:11"
},
"line_items": {
"score": 0.25,
"expected": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"got": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 4.29
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 3,
"line_total": 1.19
},
{
"description": "SANDPAPER 220 GR1T",
"quantity": 3,
"line_total": 1.97
},
{
"description": "DROP CL0TH 9X12",
"quantity": 1,
"line_total": 12.99
}
]
},
"discount": {
"score": 1,
"expected": 2,
"got": 2
},
"total": {
"score": 1,
"expected": 31.26,
"got": 31.26
},
"payment_method": {
"score": 1,
"expected": "cash",
"got": "cash"
}
},
"fields_correct": 6,
"fields_total": 7
}Ling-3.0-tiny (7.9B-A1.3B)
✗ fail · score 93 · 1.93 s
{"merchant": "HARBOR LINE HARDWARE", "date": "2026-10-09", "time": "14:11", "line_items": [{"description": "WOOD SCREWS #8 1-1/4\"", "quantity": 2, "line_total": 8.58}, {"description": "PAINTERS TAPE 1.88IN", "quantity": 3, "line_total": 6.49}, {"description": "SANDPAPER 220 GRIT", "quantity": 1, "line_total": 3.57}, {"description": "DROP CLOTH 9X12", "quantity": 1, "line_total": 12.99}], "discount": 2.00, "total": 31.26, "payment_method": "cash"}Scoring detail
{
"fields": {
"merchant": {
"score": 1,
"expected": "Harbor Line Hardware",
"got": "HARBOR LINE HARDWARE"
},
"date": {
"score": 1,
"expected": "2026-10-09",
"got": "2026-10-09"
},
"time": {
"score": 1,
"expected": "14:11",
"got": "14:11"
},
"line_items": {
"score": 0.5,
"expected": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"got": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 3,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 1,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
]
},
"discount": {
"score": 1,
"expected": 2,
"got": 2
},
"total": {
"score": 1,
"expected": 31.26,
"got": 31.26
},
"payment_method": {
"score": 1,
"expected": "cash",
"got": "cash"
}
},
"fields_correct": 6,
"fields_total": 7
}MiniCPM5 2B
✓ pass · score 100 · 2.27 s
{"merchant": "HARBOR LINE HARDWARE", "date": "2026-10-09", "time": "14:11", "line_items": [{"description": "WOOD SCREWS #8 1-1/4\"", "quantity": 2, "line_total": 8.58}, {"description": "PAINTERS TAPE 1.88IN", "quantity": 1, "line_total": 6.49}, {"description": "SANDPAPER 220 GR1T", "quantity": 3, "line_total": 3.57}, {"description": "DROP CL0TH 9X12", "quantity": 1, "line_total": 12.99}], "discount": 2.00, "total": 31.26, "payment_method": "cash"}Scoring detail
{
"fields": {
"merchant": {
"score": 1,
"expected": "Harbor Line Hardware",
"got": "HARBOR LINE HARDWARE"
},
"date": {
"score": 1,
"expected": "2026-10-09",
"got": "2026-10-09"
},
"time": {
"score": 1,
"expected": "14:11",
"got": "14:11"
},
"line_items": {
"score": 1,
"expected": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"got": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GR1T",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CL0TH 9X12",
"quantity": 1,
"line_total": 12.99
}
]
},
"discount": {
"score": 1,
"expected": 2,
"got": 2
},
"total": {
"score": 1,
"expected": 31.26,
"got": 31.26
},
"payment_method": {
"score": 1,
"expected": "cash",
"got": "cash"
}
},
"fields_correct": 7,
"fields_total": 7
}K2-Horizon 0.9B
✗ fail · score 63 · 1.43 s
{
"merchant": "HARBOR LINE HARDWARE",
"date": "2026-10-01",
"time": "14:01",
"line_items": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 1,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GR1T",
"quantity": 1,
"line_total": 3.57
},
{
"description": "DROP CL0TH 9X12",
"quantity": 1,
"line_total": 12.99
},
{
"description": "MEMBER DISC",
"quantity": 1,
"line_total": -2.00
}
],
"discount": 2.00,
"total": 31.26,
"payment_method": "cash"
}Scoring detail
{
"fields": {
"merchant": {
"score": 1,
"expected": "Harbor Line Hardware",
"got": "HARBOR LINE HARDWARE"
},
"date": {
"score": 0,
"expected": "2026-10-09",
"got": "2026-10-01"
},
"time": {
"score": 0,
"expected": "14:11",
"got": "14:01"
},
"line_items": {
"score": 0.4,
"expected": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 2,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GRIT",
"quantity": 3,
"line_total": 3.57
},
{
"description": "DROP CLOTH 9X12",
"quantity": 1,
"line_total": 12.99
}
],
"got": [
{
"description": "WOOD SCREWS #8 1-1/4\"",
"quantity": 1,
"line_total": 8.58
},
{
"description": "PAINTERS TAPE 1.88IN",
"quantity": 1,
"line_total": 6.49
},
{
"description": "SANDPAPER 220 GR1T",
"quantity": 1,
"line_total": 3.57
},
{
"description": "DROP CL0TH 9X12",
"quantity": 1,
"line_total": 12.99
},
{
"description": "MEMBER DISC",
"quantity": 1,
"line_total": -2
}
]
},
"discount": {
"score": 1,
"expected": 2,
"got": 2
},
"total": {
"score": 1,
"expected": 31.26,
"got": 31.26
},
"payment_method": {
"score": 1,
"expected": "cash",
"got": "cash"
}
},
"fields_correct": 4,
"fields_total": 7
}← summarize-extract-002All Summarize + extract itemssummarize-extract-004 →