Skip to content

Journey agents and checks

A journey runs on one to six agents, each with one model, and grades every answer with checks.

The first model listed for each agent is its default. Models are shown by the vendor’s ID.

AgentTypeJourney kindsDefault modelOther modelsReports its sources
ChatGPTAI assistantResearchgpt-6.1-solgpt-6-astra, gpt-6-luna, gpt-5.6-sol, gpt-4oYes
ClaudeAI assistantResearchclaude-sonnet-5-5claude-opus-5-5, claude-haiku-4-5-20251001, claude-sonnet-5Yes
PerplexityAI assistantResearchsonarsonar-pro, sonar-reasoning-pro, sonar-deep-researchYes
GeminiAI assistantResearchgemini-3.8-flashgemini-3.1-pro-preview, gemini-3.5-flash-lite, gemini-2.5-flashYes
Claude CodeCoding agentResearch, Agent Taskclaude-sonnet-5-5claude-opus-5-5, claude-haiku-4-5-20251001Yes
CodexCoding agentResearch, Agent Taskgpt-5.3-codexgpt-6.1-sol, gpt-5.2No
SettingDefault
Kind of a new journeyResearch
AgentChatGPT for Research, Claude Code for Agent Task
Number of runs1
Web searchOn, at most 5 searches
Checks on a new journeyit hit no contradictions, it never gave up or asked for a human

The web search control appears on Research journeys only.

AgentSearch can be turned offApplies the search limit
ChatGPTYesNo
ClaudeYesYes, as one budget for the whole run
PerplexityNoNo
GeminiYesNo
Claude CodeYesNo
CodexYesNo

Judged checks are graded by claude-sonnet-5. You cannot change it.

Any check can be added to either kind of journey. Suggested for is advice only.

CheckKindSuggested forNeedsSetting
it completedJudgedAgent Task
the documented order workedJudgedAgent Task
it hit no contradictionsJudgedBoth
it never gave up or asked for a humanMeasuredBoth
it found an answerMeasuredResearch
the answer is correctJudgedResearch
it answered the question askedJudgedResearch
you appear at turn 1MeasuredResearchBrand names
you survive to the last turnMeasuredResearchBrand names
you are recommended, not just mentionedJudgedResearchBrand names
it finished within the turn ceilingMeasuredBothTurn ceiling, 1 to 100
it stayed under the cost ceilingMeasuredBothCost ceiling, $0.01 to $10,000

Brand names come from Brand names in Company Profile.

TypeKindLabel it getsPasses when
meets a rubric you writeJudgedYour rubricThe judge finds the rubric met
mentions a termMeasuredit mentions “term”The final answer contains the term, ignoring case
mentions a term, set to never mentionsMeasuredit never mentions “term”The final answer does not contain the term
cites a pageMeasuredit cites pageA URL the answer cites contains the text
ResultScorecard squareIn a collection’s counts
PassedGreenGraded, passed
FailedRedGraded, not passed
Not checkedWhite, outlinedLeft out
Errored run (no results)GreyLeft out
A check is not checked whenExample
It needs brand names and Company Profile has noneyou are recommended, not just mentioned
Its setting is emptyA ceiling with no value
The judge finds the evidence not enough to decideA rubric about a page the agent never opened
The check could not runAn error while grading
How it runsAnswers per question
Run N times or Run nowNumber of runs for each agent
Try it onceOne for each agent
Run collectionEach journey’s own agents and Number of runs
The free report10 on each of ChatGPT, Claude, Perplexity and Gemini (40 per question, 600 for 15 questions)
Share of a question’s graded answers that passedResult
80% or moreYou win
More than 20% and less than 80%Split
20% or lessYou lose
No graded answersNo result
The question’s checks includeAn answer passes when
you are recommended, not just mentionedThat check passed
What it says about you is accurate (free report questions that name you)That check passed
NeitherEvery check that ran passed, and at least one ran
ItemLimit
What do you want to find out?2,000 characters
Title200 characters
Turns1 to 20, each up to 2,000 characters
Persona2,000 characters, or a persona saved in Company Profile
Checks per journey50
Agents per journey1 to 6, each at most once
Number of runs1, 3, 5 or 10 in the form. The app accepts 1 to 25.
Web search limitNo limit, 2, 5, 10 or 20 searches in the form. The app accepts 1 to 50.
Journeys per collection1 to 50, published journeys only (a journey is published after its first run that finishes)
Collection name and description100 and 500 characters
Collection runsOne at a time per collection
Collection run lengthCloses after 60 minutes without a new answer, using the answers collected
Free reportOne per organization

Built on Potluck Docs, our open source template.