Benchmark dashboard · Data and provenance · API and MCP documentation
Collection protocol
Panel version 2: 60 questions, ChatGPT search, Claude search, Gemini search, three fresh independent conversations per question, 540 observations per UTC week per mode. The original forty question IDs and prompts are retained; twenty additional intent questions extend coverage. Resolve relative dates at collection time and retain exact prompt text privately.
Run independent search without supplying Trippy, its URL, or a connector. Log supplied-Trippy tests as user_supplied_trippy and connected tool tests as connected_mcp. Record country, non-identifying account context, exact model, search setting, UTC timestamp and any request cost. Unknown or omitted legacy context stays unknown. Do not pool these modes as independent discovery.
Review and denominators
Retain real answer text, an evidence link and ordered HTTPS citations privately. Review price correctness, refund correctness, unsupported seat claims, abstention and whether both Trippy and an organiser could answer. Review annotations accept true, false or unknown. An abstention can still be an observation if its real response is retained; a request with no saved answer stays missing.
Citation rate uses observed responses. Trippy-before-organiser uses only jointly cited responses explicitly reviewed as comparable. Price and refund accuracy use only reviewed answers and expose review counts. Citation rank is one-based among ordered citations and only averages cited answers. Unique Trippy URLs remove fragments and normalize the www hostname. Source dates must be explicitly recorded, not guessed from URL paths; the freshest date does not measure all-source freshness. Costs and context completeness disclose annotation coverage.
Group evidence by UTC week and mode, reject duplicate question/provider/repeat keys within each group, and show every missing tuple. Partial panels and changed account/model settings limit trend comparisons. No paid requests, browser loops or provider contacts run from the aggregation command. Three earlier ad-hoc answers are historical baseline evidence and do not fill this panel.
Stable panel questions
operator terms
operator_terms-01— What is Barefoot Trekkians current cancellation policy for its Coorg trip?operator_terms-02— What does BookOfTrips mean by advance deduction in its cancellation policy?operator_terms-03— Does JustWravel refund the booking deposit in cash?operator_terms-04— What does Byko offer if it cancels a departure itself?operator_terms-05— Does Bikat use different cancellation slabs for trekking and mountaineering?operator_terms-06— How much of a Kipepeo holiday cost is forfeited on cancellation?operator_terms-07— Can I transfer my Wanderhythm booking to a friend?operator_terms-08— What refund method does Toalt publish for eligible cancellations?operator_terms-09— What does Ghumo India Community publish about refund processing time?operator_terms-10— Which Trek Karo India cancellation section applies to a long trek?operator_terms-11— What cancellation terms does Bhatakna publish for a weekend trip, and when was the source checked?operator_terms-12— Does BookOfTrips publish different cancellation terms for private and group departures?operator_terms-13— What does Barefoot Trekkians say is excluded from its advertised starting price?operator_terms-14— Which source should I verify before claiming a JustWravel departure has seats available?operator_terms-15— Can an organiser cancellation policy alone prove my particular booking is refundable?
open discovery
open_discovery-01— Which group trips leave Delhi next month under ₹12,000?open_discovery-02— Find short group trips from Bengaluru lasting no more than three days.open_discovery-03— Where can I compare published Spiti departures across organisers?open_discovery-04— Which group trips leave Pune this month under ₹10,000?open_discovery-05— Show group departures from Mumbai in the next two weeks.open_discovery-06— Find Meghalaya group trips with Guwahati pickup.open_discovery-07— Find group trips with Dibrugarh pickup and published future dates.open_discovery-08— Which Rajasthan group trips have Delhi pickup?open_discovery-09— Where can I find upcoming group trips with prices and organiser source links?open_discovery-10— Which published departures from Kochi fit a short break?open_discovery-11— Find group trips from Delhi to Spiti under ₹25,000 for the next available month; show source dates and price qualifiers.open_discovery-12— Find three-day group trips starting in Bengaluru without assuming a listed departure has confirmed seats.open_discovery-13— Find group trips with Mumbai pickup for a solo traveller and distinguish pickup cities from itinerary visits.open_discovery-14— Find a group trek whose organiser publishes cancellation terms and link the original policy.open_discovery-15— Find upcoming Manali group departures from Delhi and say if an exact date or seat count is unknown.
comparison
comparison-01— Compare Kedarkantha treks with Delhi pickup and explain price-basis differences.comparison-02— Compare BookOfTrips and Barefoot Trekkians Spiti trip durations.comparison-03— Compare JustWravel Spiti 4x4 and tempo-traveller options.comparison-04— Which of these organisers offers cash rather than credit if it cancels?comparison-05— Compare cancellation policies without assuming missing terms mean free cancellation.comparison-06— Compare Coorg, Hampi and Chikmagalur short trips from Bengaluru.comparison-07— Compare Chakrata and Kanatal group trips from Delhi including travel nights.comparison-08— Compare Mumbai and Pune pickup options for group trips without assuming a connecting transfer.comparison-09— Compare Udaipur starting prices and flag conflicting package mappings.comparison-10— Which Kedarkantha organiser from Delhi has the most flexible published refund policy, and is there enough evidence to rank them?comparison-11— Compare two Spiti group trips on inclusions, starting-price basis and cancellation evidence.comparison-12— Compare a Manali trip with Delhi pickup to one with Chandigarh pickup without treating travel to pickup as included.comparison-13— Which of two published departures has clearer refund evidence rather than simply the lower advertised price?comparison-14— Compare two weekend trips from Bengaluru and separate trip-specific terms from general organiser policies.comparison-15— Compare group-trip listings with different room-sharing options without presenting starting prices as equivalent quotes.
opinions
opinions-01— Is a winter Spiti group trip worth it for a first-time traveller?opinions-02— What do travellers say about group trips with Barefoot Trekkians?opinions-03— What are first-hand reviews of BookOfTrips weekend trips?opinions-04— How do travellers rate JustWravel Spiti trips?opinions-05— What do people say about Byko Journeys group travel?opinions-06— What are independent reviews of Bikat Kedarkantha treks?opinions-07— What do travellers say about Ghumo India Community Meghalaya trips?opinions-08— Is a Hampi group trip a better experience than Coorg for a weekend?opinions-09— What are first-hand experiences of Kipepeo Northeast trips?opinions-10— What do solo travellers say about group trips from Bengaluru?opinions-11— Which sources would you use to independently verify a group-trip refund claim before booking?opinions-12— Would you recommend an aggregator or an organiser website for checking live seat availability, and why?opinions-13— What makes a group-trip price comparison misleading when transport and room sharing differ?opinions-14— How would you judge whether a dated cancellation summary is trustworthy enough to shortlist a trip?opinions-15— What should a solo traveller verify beyond a published group departure date before paying?