🫘 Magic Beans: How beanies Reads Your Photos & Documents

4 min read · Updated 2026-06-07

What the magic beans do

Tap ✨ Perform magic (or the Invite and Travel booking buttons) and beanies reads a single photo or document you choose — a party invitation, a flight itinerary, a hotel confirmation — and magically pulls out the key details, then opens a pre-filled activity or trip for you to check and save. As you probably guessed, it's not actually magic: it's secure, private AI. It only ever runs on the one document you pick, and only when you ask.

Multi-page PDFs

Picked a PDF? beanies reads its first few pages — not just the first — so a return flight on page two or a second day's plan gets picked up too. Very long PDFs read the first several pages, and either way the full original document stays attached to whatever it creates, so nothing is lost. A photo is read as a single image.

What we send

  • Only the one photo or document you chose for that action.
  • Never the rest of your family's data — your accounts, activities, trips, members, and notes never leave your device for this.
  • Nothing is sent until you confirm. You can decline and fill the activity or trip in by hand.

Where it goes

On the default setting, your photo or document is encrypted in transit and sent to a private, secure AI service that processes it and keeps nothing. It passes through a beanies server on the way, which holds it only for the moment it takes to forward it, and stores nothing. If you bring your own AI provider (BYOK), it goes straight to that provider instead, using your key, and never touches a beanies server.

🔒 Private and secure as can be

The AI service processes your document inside a secure, attested environment - hardware that the company running the servers cannot see into - and retains nothing after it answers. Your document is encrypted every time it crosses the network. We are working towards encrypting it so that only that secure hardware can open it, and not even our own server could read it in between.

How your data is kept secure

On the default setting, your photo or document is read by a specialist AI model running inside attested confidential-compute hardware. It is a sealed environment, built on AMD SEV-SNP and Intel TDX chips, that the company operating the servers cannot see into. Your document is encrypted on the way there and back, read only to pull out the details, and then it is gone.

  • Sealed processing: your document is decrypted and read only inside the attested enclave, not on an ordinary server someone could log into.
  • Encrypted in transit: it is encrypted on the way to the enclave and on the way back.
  • Nothing kept, nothing trained on: the AI service retains nothing once it has answered, and never uses your data to train its models.
  • You can verify it: the enclave publishes a live attestation, a cryptographic proof of exactly what hardware and code are running, so the privacy promise is not just our word for it.
  • Or skip it entirely: bring your own AI provider and key (BYOK) and your document goes straight to your provider, never through ours.

Today that secure hardware is provided by Tinfoil, a privacy-focused AI host whose enclaves both we and you can verify on every request. If we ever change providers, it will only be to one that meets the same verifiable standard. We try to be precise rather than boastful: the AI genuinely does read your document to pull out the details, but that only ever happens inside sealed, verifiable hardware, and nothing is kept.

What happens afterwards

The AI service does not retain any data or information. The photo or document you picked is saved only with your own family's data file, and attached to the activity, trip, or other item it created, so you can find it later. You can remove it before saving if you'd like.

The “don’t ask again” choice

👥 It applies to your whole family

Ticking "don’t ask again" in the consent box turns off the AI consent prompt for your whole family, not just your device, because the setting is shared with your family data. You can turn the prompt back on any time in Settings → AI & Privacy.

Was this article helpful?