Benchmarks / Which Small AI Model Should You Run on a Mac? We Ran 312 Tests / Summarize + extract

summarize-extract-006

medium extractionreceipt

The prompt

user

Extract information from the receipt below. Reply with only a JSON object with exactly these keys:
- "merchant" (string): store name without the store number
- "date" (string "YYYY-MM-DD"): purchase date
- "subtotal" (number): subtotal before tax
- "tax" (number): tax amount
- "total" (number): total charged
- "total_savings" (number): total amount saved on this purchase
- "rewards_member_id" (string): rewards member ID
- "payment_method" (string): one of "cash", "credit", "debit", "other"

Rules: include every key listed. Use null for any field that is not stated in the text (do not guess). Dates are YYYY-MM-DD. Times are HH:MM in 24-hour format. Amounts and counts are plain JSON numbers (no currency symbols, no commas). Phone numbers are in international format with + and the country code, for example +1 312 555 0100; leave out any national trunk prefix 0, so (0)20 or 020 becomes 20 after +44.

Receipt:
"""
      WELLSPRING PHARMACY  #1189
   900 Cedar Crossing, Tulsa OK 74133
        Store: (918) 555-0125

11-02-2026  10:31   Reg 1   Trans 66120
Rewards Member: WS-55102

ALLERGY RELIEF 24HR 30CT        18.99
   REWARDS PRICE                -4.00
VITAMIN D3 2000IU 90CT           9.49
COUGH DROPS HONEY  2 @ 3.29      6.58
   BUY 1 GET 1 50% OFF          -1.65

SUBTOTAL                        29.41
TAX  8.517%                      2.50
TOTAL                           31.91

VISA CREDIT  ************2286   31.91

  *** YOU SAVED 5.65 TODAY! ***
  Rewards balance: 12.00 in ShopBucks
  Spend 18.09 more to earn 5.00 ShopBucks
"""

What we expected

{
  "kind": "extract",
  "answer": {
    "merchant": "Wellspring Pharmacy",
    "date": "2026-11-02",
    "subtotal": 29.41,
    "tax": 2.5,
    "total": 31.91,
    "total_savings": 5.65,
    "rewards_member_id": "WS-55102",
    "payment_method": "credit"
  },
  "fields": {
    "merchant": {
      "type": "string",
      "accept": [
        "Wellspring Pharmacy #1189",
        "Wellspring Pharmacy 1189"
      ]
    },
    "date": {
      "type": "date"
    },
    "subtotal": {
      "type": "number"
    },
    "tax": {
      "type": "number"
    },
    "total": {
      "type": "number"
    },
    "total_savings": {
      "type": "number"
    },
    "rewards_member_id": {
      "type": "code"
    },
    "payment_method": {
      "type": "enum"
    }
  }
}

What each model answered

MiMo-V2.6 Distill 9B

✓ pass · score 100 · 3.70 s

{"merchant": "Wellspring Pharmacy", "date": "2026-11-02", "subtotal": 29.41, "tax": 2.5, "total": 31.91, "total_savings": 5.65, "rewards_member_id": "WS-55102", "payment_method": "credit"}

Scoring detail

{
  "fields": {
    "merchant": {
      "score": 1,
      "expected": "Wellspring Pharmacy",
      "got": "Wellspring Pharmacy"
    },
    "date": {
      "score": 1,
      "expected": "2026-11-02",
      "got": "2026-11-02"
    },
    "subtotal": {
      "score": 1,
      "expected": 29.41,
      "got": 29.41
    },
    "tax": {
      "score": 1,
      "expected": 2.5,
      "got": 2.5
    },
    "total": {
      "score": 1,
      "expected": 31.91,
      "got": 31.91
    },
    "total_savings": {
      "score": 1,
      "expected": 5.65,
      "got": 5.65
    },
    "rewards_member_id": {
      "score": 1,
      "expected": "WS-55102",
      "got": "WS-55102"
    },
    "payment_method": {
      "score": 1,
      "expected": "credit",
      "got": "credit"
    }
  },
  "fields_correct": 8,
  "fields_total": 8
}

Ornith-1.5 9B

✓ pass · score 100 · 3.48 s

{
  "merchant": "Wellspring Pharmacy",
  "date": "2026-11-02",
  "subtotal": 29.41,
  "tax": 2.5,
  "total": 31.91,
  "total_savings": 5.65,
  "rewards_member_id": "WS-55102",
  "payment_method": "credit"
}

Scoring detail

{
  "fields": {
    "merchant": {
      "score": 1,
      "expected": "Wellspring Pharmacy",
      "got": "Wellspring Pharmacy"
    },
    "date": {
      "score": 1,
      "expected": "2026-11-02",
      "got": "2026-11-02"
    },
    "subtotal": {
      "score": 1,
      "expected": 29.41,
      "got": 29.41
    },
    "tax": {
      "score": 1,
      "expected": 2.5,
      "got": 2.5
    },
    "total": {
      "score": 1,
      "expected": 31.91,
      "got": 31.91
    },
    "total_savings": {
      "score": 1,
      "expected": 5.65,
      "got": 5.65
    },
    "rewards_member_id": {
      "score": 1,
      "expected": "WS-55102",
      "got": "WS-55102"
    },
    "payment_method": {
      "score": 1,
      "expected": "credit",
      "got": "credit"
    }
  },
  "fields_correct": 8,
  "fields_total": 8
}

Granite 4.2 8B

✓ pass · score 100 · 3.33 s

{
  "merchant": "WELLSPRING PHARMACY",
  "date": "2026-11-02",
  "subtotal": 29.41,
  "tax": 2.5,
  "total": 31.91,
  "total_savings": 5.65,
  "rewards_member_id": "WS-55102",
  "payment_method": "credit"
}

Scoring detail

{
  "fields": {
    "merchant": {
      "score": 1,
      "expected": "Wellspring Pharmacy",
      "got": "WELLSPRING PHARMACY"
    },
    "date": {
      "score": 1,
      "expected": "2026-11-02",
      "got": "2026-11-02"
    },
    "subtotal": {
      "score": 1,
      "expected": 29.41,
      "got": 29.41
    },
    "tax": {
      "score": 1,
      "expected": 2.5,
      "got": 2.5
    },
    "total": {
      "score": 1,
      "expected": 31.91,
      "got": 31.91
    },
    "total_savings": {
      "score": 1,
      "expected": 5.65,
      "got": 5.65
    },
    "rewards_member_id": {
      "score": 1,
      "expected": "WS-55102",
      "got": "WS-55102"
    },
    "payment_method": {
      "score": 1,
      "expected": "credit",
      "got": "credit"
    }
  },
  "fields_correct": 8,
  "fields_total": 8
}

Spark-X2.5 4B

✗ fail · score 88 · 2.57 s

{
  "merchant": "WELLSPRING PHARMACY",
  "date": "11-02-2026",
  "subtotal": 29.41,
  "tax": 2.5,
  "total": 31.91,
  "total_savings": 5.65,
  "rewards_member_id": "WS-55102",
  "payment_method": "credit"
}

Scoring detail

{
  "fields": {
    "merchant": {
      "score": 1,
      "expected": "Wellspring Pharmacy",
      "got": "WELLSPRING PHARMACY"
    },
    "date": {
      "score": 0,
      "expected": "2026-11-02",
      "got": "11-02-2026"
    },
    "subtotal": {
      "score": 1,
      "expected": 29.41,
      "got": 29.41
    },
    "tax": {
      "score": 1,
      "expected": 2.5,
      "got": 2.5
    },
    "total": {
      "score": 1,
      "expected": 31.91,
      "got": 31.91
    },
    "total_savings": {
      "score": 1,
      "expected": 5.65,
      "got": 5.65
    },
    "rewards_member_id": {
      "score": 1,
      "expected": "WS-55102",
      "got": "WS-55102"
    },
    "payment_method": {
      "score": 1,
      "expected": "credit",
      "got": "credit"
    }
  },
  "fields_correct": 7,
  "fields_total": 8
}

Mellum2.1 12B-A2.5B

✓ pass · score 100 · 1.68 s

{
  "merchant": "WELLSPRING PHARMACY",
  "date": "2026-11-02",
  "subtotal": 29.41,
  "tax": 2.5,
  "total": 31.91,
  "total_savings": 5.65,
  "rewards_member_id": "WS-55102",
  "payment_method": "credit"
}

Scoring detail

{
  "fields": {
    "merchant": {
      "score": 1,
      "expected": "Wellspring Pharmacy",
      "got": "WELLSPRING PHARMACY"
    },
    "date": {
      "score": 1,
      "expected": "2026-11-02",
      "got": "2026-11-02"
    },
    "subtotal": {
      "score": 1,
      "expected": 29.41,
      "got": 29.41
    },
    "tax": {
      "score": 1,
      "expected": 2.5,
      "got": 2.5
    },
    "total": {
      "score": 1,
      "expected": 31.91,
      "got": 31.91
    },
    "total_savings": {
      "score": 1,
      "expected": 5.65,
      "got": 5.65
    },
    "rewards_member_id": {
      "score": 1,
      "expected": "WS-55102",
      "got": "WS-55102"
    },
    "payment_method": {
      "score": 1,
      "expected": "credit",
      "got": "credit"
    }
  },
  "fields_correct": 8,
  "fields_total": 8
}

Ling-3.0-tiny (7.9B-A1.3B)

✓ pass · score 100 · 1.07 s

{"merchant": "WELLSPRING PHARMACY", "date": "2026-11-02", "subtotal": 29.41, "tax": 2.50, "total": 31.91, "total_savings": 5.65, "rewards_member_id": "WS-55102", "payment_method": "credit"}

Scoring detail

{
  "fields": {
    "merchant": {
      "score": 1,
      "expected": "Wellspring Pharmacy",
      "got": "WELLSPRING PHARMACY"
    },
    "date": {
      "score": 1,
      "expected": "2026-11-02",
      "got": "2026-11-02"
    },
    "subtotal": {
      "score": 1,
      "expected": 29.41,
      "got": 29.41
    },
    "tax": {
      "score": 1,
      "expected": 2.5,
      "got": 2.5
    },
    "total": {
      "score": 1,
      "expected": 31.91,
      "got": 31.91
    },
    "total_savings": {
      "score": 1,
      "expected": 5.65,
      "got": 5.65
    },
    "rewards_member_id": {
      "score": 1,
      "expected": "WS-55102",
      "got": "WS-55102"
    },
    "payment_method": {
      "score": 1,
      "expected": "credit",
      "got": "credit"
    }
  },
  "fields_correct": 8,
  "fields_total": 8
}

MiniCPM5 2B

✓ pass · score 100 · 1.32 s

{"merchant": "Wellspring Pharmacy", "date": "2026-11-02", "subtotal": 29.41, "tax": 2.50, "total": 31.91, "total_savings": 5.65, "rewards_member_id": "WS-55102", "payment_method": "credit"}

Scoring detail

{
  "fields": {
    "merchant": {
      "score": 1,
      "expected": "Wellspring Pharmacy",
      "got": "Wellspring Pharmacy"
    },
    "date": {
      "score": 1,
      "expected": "2026-11-02",
      "got": "2026-11-02"
    },
    "subtotal": {
      "score": 1,
      "expected": 29.41,
      "got": 29.41
    },
    "tax": {
      "score": 1,
      "expected": 2.5,
      "got": 2.5
    },
    "total": {
      "score": 1,
      "expected": 31.91,
      "got": 31.91
    },
    "total_savings": {
      "score": 1,
      "expected": 5.65,
      "got": 5.65
    },
    "rewards_member_id": {
      "score": 1,
      "expected": "WS-55102",
      "got": "WS-55102"
    },
    "payment_method": {
      "score": 1,
      "expected": "credit",
      "got": "credit"
    }
  },
  "fields_correct": 8,
  "fields_total": 8
}

K2-Horizon 0.9B

✗ fail · score 88 · 0.66 s

{
  "merchant": "WELLSPRING PHARMACY",
  "date": "2026-02-11",
  "subtotal": 29.41,
  "tax": 2.50,
  "total": 31.91,
  "total_savings": 5.65,
  "rewards_member_id": "WS-55102",
  "payment_method": "credit"
}

Scoring detail

{
  "fields": {
    "merchant": {
      "score": 1,
      "expected": "Wellspring Pharmacy",
      "got": "WELLSPRING PHARMACY"
    },
    "date": {
      "score": 0,
      "expected": "2026-11-02",
      "got": "2026-02-11"
    },
    "subtotal": {
      "score": 1,
      "expected": 29.41,
      "got": 29.41
    },
    "tax": {
      "score": 1,
      "expected": 2.5,
      "got": 2.5
    },
    "total": {
      "score": 1,
      "expected": 31.91,
      "got": 31.91
    },
    "total_savings": {
      "score": 1,
      "expected": 5.65,
      "got": 5.65
    },
    "rewards_member_id": {
      "score": 1,
      "expected": "WS-55102",
      "got": "WS-55102"
    },
    "payment_method": {
      "score": 1,
      "expected": "credit",
      "got": "credit"
    }
  },
  "fields_correct": 7,
  "fields_total": 8
}

← summarize-extract-005All Summarize + extract itemssummarize-extract-007 →