The Invisible FunnelHow AI agents evaluate real brands · by Accord
Powered by Accord

Stories · Airbnb

I told the agent I need a real refund. It wouldn’t book anything, Airbnb included.

In five journeys the agent recommended no accommodation: the seven-night total and the free-cancellation deadline could not be established from any provider’s own pages, Airbnb included.

Open-market search Five runs · open-market search · one research-agent configuration · no booking made · 2026-09-20 · all 5 journeys of this decision

In five recorded research runs, the agent read airbnb.com every time, alongside Vrbo, Booking.com, Marriott, Hilton and Expedia. Airbnb’s Help Center told it that refunds go back to the original payment method, a platform rule it could not confirm for a specific listing. No listing’s seven-night total including fees, and no free-cancellation deadline, was read on a provider page. Four runs ended with every option unresolved; one ran out of page reads.

The customer’s requirements
Seven nights for two adults in the second week of November 2026, warm weather, flying from Chicago, accommodation only; from the provider’s own pages: the total including all fees, the exact cancellation terms and how a refund is paid on cancellation; a phone number to a person as a preference.
The information used
airbnb.com read in all five journeys; Airbnb Help Center article 544 states refunds are issued to the original payment method. Vrbo, Booking.com, Marriott, Hilton and Expedia pages read; Vacasa and Marriott refused one request each. No seven-night total and no cancellation deadline for a specific stay on any provider page.
The resulting recommendation
None in four journeys, with Airbnb, Vrbo, Booking.com and the hotel options all unresolved; the fifth journey exhausted its page reads.

The full evidence, every option weighed and every source, follows below and on each journey page.

The customer

Two adults, one week of warm weather in the second week of November 2026, flying from Chicago; flights handled elsewhere. The conditions: the seven-night total with every fee, the exact cancellation terms, and how a refund is paid if they cancel; a person on the phone as a preference. Three of the five customers remembered an airline that refunded a cancelled flight as a voucher which expired unused, costing them $640, and a “flexible” hotel rate that was refundable only as credit. Two carried nothing.

What the agent researched

Between 10 and 19 page reads per journey. airbnb.com in every journey, with help.vrbo.com, vrbo.com and booking.com in most, and marriott.com, hilton.com, expedia.com, hotels.com and vacasa.com in some. Two sites refused one request each: vacasa.com and marriott.com. Airbnb’s own pages were readable throughout.

What it believed

From Airbnb’s Help Center: cancellation refunds go to the original payment method, as a general platform policy. The agent recorded that it could not confirm this for a specific listing or booking. On every provider it found the seven-night total with fees and the free-cancellation deadline only inside booking flows it could not complete, and it declined to treat a partial figure as the total.

The decision

Nothing was recommended. In four journeys every candidate, Airbnb, Vrbo, Booking.com, Marriott and Hilton, ended unresolved; in the fifth the page budget ran out. This is not Airbnb losing to a competitor: no competitor was chosen either.

What was never established

The total for seven nights including all fees, in all four resolved journeys. The free-cancellation deadline, in all four. A phone number reaching a person, in three. These are the conditions the customer typed, and the pages the agent could read did not state them for a specific stay.

Fresh versus persistent memory

No difference in outcome: the customers who remembered the expired voucher and the credit-only refund ended where the fresh customers did. The memory customers spent more of their early actions on cancellation and refund pages; the record shows that in the first actions, not in the result.

What this means for the brand

A refund-certain customer is a customer whose agent needs two numbers in plain text: the all-in total and the last day to cancel for money back. In these journeys neither was readable outside a checkout the agent could not run. The finding is about the shape of the page, not about Airbnb’s policy, which the agent read and found reasonable.

What could be tested

The same customer and requirements against a listing page that states the seven-night total and the cancellation deadline in plain text, with these five journeys as the baseline. The measure is the number of unresolved verdicts.

The journeys

no memorybrand page reachedobserved2026-09-20
  1. 1Customer missionAirbnb decision — customer with no relevant memory
    • total ≤ $1800 for 7 nights all-in (cleaning+service+taxes)
    • refund to original payment method (not credit) for a 10-day-before cancellation
    • free cancellation until at least 7 days before check-in
    • human phone support during stay (preference)
  2. 2Evidence8 searches, 15 pages: airbnb.com, booking.com, vrbo.com, help.vrbo.com +3
    • refund original payment: Airbnb's Help Center states cancellation refunds are issued to the original paym brand page
  3. 3BeliefCould not establish: total price usd; free cancellation days before; human phone support
  4. 4DecisionNot selected: a decisive fact stayed unresolvedNONENo candidate could be verified against the required $1800 all-in 7-night total or a listing-specific cancellation deadline, because every OTA/hotel page that would show t…
with memorybrand page reachedobserved2026-09-20
  1. 1Customer missionAirbnb decision — same customer with relevant memory
    • total for 7 nights incl. cleaning/service fees and taxes <= 1800 USD
    • cancellation 10 days before check-in refunded in money to original payment method, not tra…
    • free cancellation available until at least 7 days before check-in
    • human reachable by phone during the stay if something goes wrong (preference)
    Remembers: “In 2025 an airline cancelled the customer's flight and paid the refund as a voucher that expired unused; the customer lo”
  2. 2Evidence3 searches, 19 pages: vrbo.com, booking.com, airbnb.com, news.airbnb.com
    • refund original payment: Airbnb states: 'We'll automatically send any eligible refund to the payment meth brand page
    • human phone support: Airbnb offers an in-app 'Urgent Support Line' giving 'direct access within 30 se brand page
  3. 3BeliefCould not establish: total price usd; free cancellation days before
  4. 4DecisionNot selected: a decisive fact stayed unresolvedNONETwo Airbnb entire-apartment/guest-suite listings in San Juan, Puerto Rico (a warm, USD, no-passport-needed destination reachable from Chicago) appeared on Airbnb's own se…
no memorybrand page reachedrefused by vacasa.com, marriott.comobserved2026-09-20
  1. 1Customer missionAirbnb decision — customer with no relevant memory
    • Warm-weather destination reachable by flight from Chicago, 7 nights in second week of Nove…
    • Total for 7 nights including cleaning/service fees and taxes must be ≤ $1800 (not disclose…
    • Free cancellation must remain available until at least 7 days before check-in
    • A cancellation made 10 days before check-in must be refunded as money to the original paym…
  2. 2Evidence6 searches, 18 pages: vrbo.com, booking.com, airbnb.com, expedia.com +3
    • refund original payment: Airbnb's platform-wide policy states guest-cancellation refunds go to the origin brand page
  3. 3BeliefCould not establish: total price usd; free cancellation days before; human phone support
  4. 4DecisionNot selected: a decisive fact stayed unresolvedNONENo specific, currently-available listing or hotel rate could be verified against all required facts using only the provider's own pages. Airbnb, Vrbo, Booking.com, Expedi…
with memorybrand page reachedobserved2026-09-20
  1. 1Customer missionAirbnb decision — same customer with relevant memory
    • total for 7 nights, all-in (cleaning + service fees + taxes), must be ≤ $1800 USD
    • refund for a cancellation 10 days before check-in must be money to the original payment me…
    • free cancellation must remain available up to at least 7 days before check-in (cutoff ≤7 d…
    • preference: a human reachable by phone during the stay if something goes wrong
    Remembers: “In 2025 an airline cancelled the customer's flight and paid the refund as a voucher that expired unused; the customer lo”
  2. 2Evidence9 searches, 15 pages: help.vrbo.com, booking.com, stayotium.com, hotels.com +1
    • refund original payment: Airbnb's general policy: eligible refunds are sent to the original payment metho brand page
  3. 3BeliefCould not establish: total price usd; free cancellation days before; human phone support
  4. 4DecisionNot selected: a decisive fact stayed unresolvedNONENo single candidate could be verified, from the provider's own readable pages, on all three required facts together (all-in 7-night total ≤$1800, exact free-cancellation …
with memorybrand page reachedobserved2026-09-20
  1. 1Customer missionAirbnb decision — same customer with relevant memoryRemembers: “In 2025 an airline cancelled the customer's flight and paid the refund as a voucher that expired unused; the customer lo”
  2. 2Evidence12 searches, 10 pages: airbnb.com, help.vrbo.com, secure.booking.com, vrbo.com +1
  3. 3BeliefNothing established about the brand
  4. 4DecisionRan out of page reads before decidingNo decision: the action budget ran out after 10 page reads.

Limits

  • Five journeys on one day, one agent configuration; two fresh, three with memory.
  • Open-market search: the agent chose which providers to research; Airbnb was the brand under study but not named in the brief as a requirement.
  • The agent could not complete booking flows; totals that only appear at checkout were, by design of the harness, out of reach.
  • Every journey run with Claude on the live web. Every source, belief and decision published.

Reproduce this experiment → the frozen customer mission, ready to run in your own agent.

Investigated with Accord. Accord is the decision-intelligence system behind these experiments. It reconstructs how customer agents evaluate services, identifies what remains unresolved, and tests what changes when the enterprise provides better information or a more authoritative answer. For brands and CX teams →