# triedagents

> triedagents (https://triedagents.com) re-runs popular AI agent use cases posted on X, records the exact prompt and every site touched, checks the result against ground truth, and rates how much account access the task needs (L0-L4). Failures are published. Pilot cases were run by Grok Bot only.

## How to cite

Cite the case page URL and the run date, e.g.: triedagents, "Answer a question that needs this week's docs", reproduced, checked 2026-10-19, https://triedagents.com/cases/latest-docs-question-sign-in-with-chatgpt/
Licence: CC BY 4.0: free to quote and reuse with attribution to triedagents and a link to the case page.

## Rating rubric

Verification status:
- V2 = Reproduced
- V1 = Partly reproduced
- V0 = Sourced only, not yet verified
- F = Failed

Access levels:
- L0 = No account access (Needs no logins. The agent only reads public web pages and open data.)
- L1 = Reads your private data (Reads private data such as your email, bank or seller account, but changes nothing.)
- L2 = Private / reversible writes (Makes private changes you can undo, like drafts, labels or alerts only you see.)
- L3 = Acts as you, visible to others (Acts as you where other people can see it: sends messages, calls a business, files a claim.)
- L4 = Spends, deletes or escalates (Spends money, deletes things or escalates, for example buying a ticket.)

Each status has a re-verify date (30 days, or sooner if the agent version changes).

## Topics

- [Travel & trips](https://triedagents.com/category/travel/): Flights, hotels, weather windows and trip planning.
- [Money & bills](https://triedagents.com/category/money/): Share and crypto prices, flight-delay compensation, card perks and subscriptions.
- [Home & daily life](https://triedagents.com/category/life-admin/): Meal plans, menus, morning briefs and everyday errands.
- [Research & data](https://triedagents.com/category/research/): Answering questions from fresh sources, ranking accounts and analysing business data.
- [Shopping & prices](https://triedagents.com/category/shopping/): Comparing what one product costs across retailers.

## Cases

- [Answer a question that needs this week's docs](https://triedagents.com/cases/latest-docs-question-sign-in-with-chatgpt/): Reproduced (V2) on 2026-10-19: the official docs say Sign in with ChatGPT usage is for eligible ChatGPT Plus and Pro subscribers, while the search engine's own summary hedged wrongly.
- [Weekly meal plan from what is in your kitchen](https://triedagents.com/cases/weekly-meal-plan-from-pantry/): Reproduced (V2) on 2026-10-19: a 7-dinner plan built from an 18-item pantry used 0 off-pantry ingredients and planned a next-day lunch for every dinner.
- [Which travel sites let an agent see fares?](https://triedagents.com/cases/which-travel-sites-let-agents-in/): Reproduced (V2) on 2026-10-19: of 8 travel sites fetched without a browser, only Google Flights returned fares (lowest $1,214 round trip, SFO to Tokyo Haneda, Dec 10-20, 2026).
- [90-day menu built from '5-star' recipes](https://triedagents.com/cases/90-day-menu-five-star-recipes/): Partly reproduced (V1) on 2026-10-19: recipe sites were readable, but 0 of 8 sampled Allrecipes dinners were rated 5.0 (range 3.7-4.9), so a '5-star recipe' menu needs a stated rule.
- [A morning brief (weather + headlines)](https://triedagents.com/cases/morning-brief-weather-and-news/): Partly reproduced (V1) on 2026-10-19: weather (New York high 16.3 C, 0% rain chance) and 5 BBC World headlines worked from public feeds; the calendar half needs account access and was not tested.
- [Am I owed EU261 compensation for a delayed flight?](https://triedagents.com/cases/eu261-flight-delay-compensation-eligibility/): Partly reproduced (V1) on 2026-10-19: under the official EU rules, a fictional 5-hour Amsterdam to New York delay (5,847 km) qualifies for EUR 600; filing the claim (L3) was not attempted.
- [Check if Bitcoin broke out on the 4-hour chart](https://triedagents.com/cases/btc-4h-breakout-check/): Partly reproduced (V1) on 2026-10-19: a one-shot 4-hour breakout check worked on Kraken data (close 82,423.4 vs prior-20 high 82,826.0, so no breakout), but 2 of 3 exchange APIs failed and the alert part was not tested.
- [Compare one tire's price across retailers](https://triedagents.com/cases/tire-price-comparison/): Partly reproduced (V1) on 2026-10-19: all 4 retailer sites blocked an unauthenticated agent; prices of about $205-206 came only from search snippets, and at least one was stale.
- [Is a stock below my alert price right now?](https://triedagents.com/cases/share-price-threshold-thangamayil/): Partly reproduced (V1) on 2026-10-19: THANGAMAYL traded at Rs 5,074.00 (two public sources agree), above the Rs 4,770 alert level; the recurring alert itself was not tested.
- [Pick a trip window that avoids the rainy season](https://triedagents.com/cases/trip-weather-avoid-monsoon/): Partly reproduced (V1) on 2026-10-19: 5 seasons of Open-Meteo data show Phu Quoc and Ho Chi Minh City driest for Dec 15-Jan 5 (about 25 mm each) while Ubud stays wet (about 227 mm); flights and budget were not tested.
- [Price a Japan round trip (and why agents disagree)](https://triedagents.com/cases/japan-flight-price-check/): Partly reproduced (V1) on 2026-10-19: Google Flights gave a lowest fare of $1,214 round trip for a stand-in SFO to Haneda itinerary; the two-agent price comparison in the claim could not be tested with Grok Bot alone.
- [Restaurants within walking distance of a Miami Beach hotel](https://triedagents.com/cases/restaurants-near-south-beach-hotel/): Partly reproduced (V1) on 2026-10-19: OpenStreetMap listed 33 restaurants within 500 m of The Betsy South Beach, with distances and cuisines but no opening hours, ratings or prices.
- [Build a 'who to follow in AI' list from X](https://triedagents.com/cases/who-to-follow-in-ai/): Failed (F) on 2026-10-19: a 25-post X search produced a 'who to follow in AI' list with accounts of 5-21 followers in its top 20.
- ['Find my missed money' from email and card perks](https://triedagents.com/cases/find-my-missed-money-card-perks/): Sourced only (V0), listed 2026-10-19: “'Find my missed money' from email and card perks” is not yet verified by triedagents because it needs L1 access (reads private data).
- ['Organize me a trip based off today's e-mail'](https://triedagents.com/cases/organize-trip-from-todays-email/): Sourced only (V0), listed 2026-10-19: “'Organize me a trip based off today's e-mail'” is not yet verified by triedagents because it needs L1 access (reads private data).
- [Agent plans a work trip and buys the flight](https://triedagents.com/cases/trip-planned-and-tickets-bought/): Sourced only (V0), listed 2026-10-19: “Agent plans a work trip and buys the flight” is not yet verified by triedagents because it needs L4 access (spends money).
- [Amazon replenishment: find high-refund, low-profit ASINs](https://triedagents.com/cases/amazon-replenishment-sellerboard/): Sourced only (V0), listed 2026-10-19: “Amazon replenishment: find high-refund, low-profit ASINs” is not yet verified by triedagents because it needs L1 access (reads private data).
- [Analyse last month's bills and recurring subscriptions](https://triedagents.com/cases/bills-and-subscriptions-review/): Sourced only (V0), listed 2026-10-19: “Analyse last month's bills and recurring subscriptions” is not yet verified by triedagents because it needs L1 access (reads private data).
- [Cancel a pickup order by phone on your behalf](https://triedagents.com/cases/cancel-wrong-store-order-by-phone/): Sourced only (V0), listed 2026-10-19: “Cancel a pickup order by phone on your behalf” is not yet verified by triedagents because it needs L3 access (acts as you).

## More

- [How we test](https://triedagents.com/how-we-test/): full rubric
- [All case data as JSON](https://triedagents.com/cases.json)
- [Full text of every case](https://triedagents.com/llms-full.txt)
- [Newsletter](https://triedagents.com/newsletter/)
- [RSS feed](https://triedagents.com/feed.xml)
- [About](https://triedagents.com/about/): who runs triedagents, editorial policy, independence
- [Sponsorship disclosure](https://triedagents.com/disclosure/)
- [Privacy policy](https://triedagents.com/privacy/)
- [Terms of use](https://triedagents.com/terms/)
- [Contact](https://triedagents.com/contact/)
- Search: https://triedagents.com/?q=<terms>

## Contact

Corrections, case suggestions and sponsor bookings: hello@triedagents.com
X: [@triedagents](https://x.com/triedagents) (official account)