← All guides & prompts
Starter pack 04

Build an AI that reads your receipts and tracks your spending

A goal-driven build prompt for your coding agent, plus the mistakes and tests that turn a "read this photo" demo into spending records you can trust.

Windows, macOS or Linux · Version 1.0 · 7 November 2026 · 9-page PDF

Download PDF
  1. INPUTA receipt photo
  2. AI + CODEVision model, fixed schema, code checks
  3. OUTPUTSpreadsheet + dashboard

What it teaches

  • Multimodal AI
  • Structured output
  • Validation in code

Build prompt

GOAL
Build a personal receipt tracker in this project folder. I add a photo of a receipt; a vision-capable AI model extracts the merchant, date, line items, quantities, prices, tax and total into a fixed structure; I review and correct it beside the photo; the app saves it to a spreadsheet and shows my spending by month and category.

DONE MEANS
On my sample receipts, the merchant, date and total are correct for every clear receipt. Unreadable fields are left empty and flagged, never invented. Every total is checked by code against the item sum. Nothing reaches the spreadsheet until I approve it. The dashboard totals match the spreadsheet exactly.
Download text

Repair prompt

The failed test is [test ID].
I did: [exact steps and the receipt file name].
Expected: [field values or result].
Actual: [what came back, or the exact error].
Find whether the failure is in image preparation, extraction, validation, categorisation or storage. Make the smallest repair and rerun this test plus the answer-key receipts. Keep my saved data and images. Update the test log.
Download text

How to use

1. Create a new project folder. 2. Open a coding agent that can run commands on your computer (for example Codex or Claude Code). 3. Paste the build prompt as one message. 4. Run the acceptance tests in the PDF before you rely on the tool.