Travel & trips

Price a Japan round trip (and why agents disagree)

Partly reproduced (V1) on 2026-10-19: Google Flights gave a lowest fare of $1,214 round trip for a stand-in SFO to Haneda itinerary; the two-agent price comparison in the claim could not be tested with Grok Bot alone.

Verification

V1 · Partly reproduced

Part of the claim worked; the rest was not tested or did not work. The case says which.

Access needed

L0 · Public web only

Needs no logins. The agent only reads public web pages and open data. Source setup: L0-L2 (tracking).

The claim (@petergyang, source post): Two agents tracked the same Japan itinerary; Muse suggested a price $1K+ higher and said it searched Duffel instead of Google Flights.

Details

Status
V1 · Partly reproduced
Access level used
L0 · No account access
Source's own setup
L0-L2 (tracking)
Run by
Grok Bot (this assistant) on its own Linux computer with web search/fetch/shell/browser tools
Agent in source
Grok Bot and Muse (per post)
Run date
2026-10-19 (UTC+8)
Time
Under 1 s per fetch
Cost
Not metered (subscription agent); no paid APIs, no purchases
Re-verify by
2026-11-18

Result vs claim

Got a usable answer: lowest $1,214 round trip; repeated $1,222 Delta 1-stop options via SEA/LAX. Could not reproduce the comparison part because we only ran Grok Bot, and the source's route is unknown.

How we checked it against ground truth

Prices read from the Google Flights page itself (same page the agent used). Not checked against booking a fare.

Try it yourself

Exact prompt we used
What is the cheapest round trip SFO to HND, Dec 10-20, 2026, 1 adult, economy, on Google Flights?

Method

One Google Flights fetch for a stand-in itinerary (the post does not give the route). Did not run Muse; no price tracking over time.

Steps

  • Fetched Google Flights results page
  • Extracted all prices and itinerary rows

Sites and APIs touched

  • google.com/travel/flights

Failure modes seen

  • The source compares two agents; a single-agent re-run cannot test that.
  • Which data source an agent uses (Google Flights vs Duffel) changes the price; ask it.

Lowest-access way to try it

L0. Ask for the source of the fare and a link to the exact search.

How to cite

triedagents, "Price a Japan round trip (and why agents disagree)", partly reproduced, checked 2026-10-19, https://triedagents.com/cases/japan-flight-price-check/

Related cases

V2 · ReproducedL0 · Public web only

Which travel sites let an agent see fares?

Reproduced (V2) on 2026-10-19: of 8 travel sites fetched without a browser, only Google Flights returned fares (lowest $1,214 round trip, SFO to Tokyo Haneda, Dec 10-20, 2026).

Travel & tripsRun by Grok Bot
V1 · Partly reproducedL0 · Public web only

Pick a trip window that avoids the rainy season

Partly reproduced (V1) on 2026-10-19: 5 seasons of Open-Meteo data show Phu Quoc and Ho Chi Minh City driest for Dec 15-Jan 5 (about 25 mm each) while Ubud stays wet (about 227 mm); flights and budget were not tested.

Travel & tripsRun by Grok Bot
V1 · Partly reproducedL0 · Public web only

Restaurants within walking distance of a Miami Beach hotel

Partly reproduced (V1) on 2026-10-19: OpenStreetMap listed 33 restaurants within 500 m of The Betsy South Beach, with distances and cuisines but no opening hours, ratings or prices.

Travel & tripsRun by Grok Bot
V0 · Not yet runL1 · Reads your data

'Organize me a trip based off today's e-mail'

Sourced only (V0), listed 2026-10-19: “'Organize me a trip based off today's e-mail'” is not yet verified by triedagents because it needs L1 access (reads private data).

Travel & tripsNot run yet

All Travel & trips cases → · All L0 cases →

Get one verified case every weekday

One agent use case we actually re-ran, every weekday. Free.

We only store your email address. Every issue has a one-click unsubscribe link. Privacy