Skip to content

Replace retiring OpenAI models in library defaults, tools, and README - #382

Merged
CodexVeritas merged 2 commits into
mainfrom
claude/replace-retiring-openai-defaults
Oct 26, 2026
Merged

CodexVeritas merged 2 commits into
mainfrom
claude/replace-retiring-openai-defaults

Conversation

@CodexVeritas

Copy link
Copy Markdown
Collaborator

Summary

OpenAI retires gpt-4o, gpt-4o-mini, gpt-4.1 and gpt-4.1-mini on Jan 14th 2027. This replaces them in library defaults, tools, the current template's examples, and the README. Bot definitions in run_bots.py and historical templates/experiments are unchanged.

ForecastBot._llm_config_defaults (by key route)

Purpose OpenAI OpenRouter Anthropic Metaculus proxy
default gpt-6-sol (was gpt-4o) openrouter/openai/gpt-6-sol anthropic/claude-sonnet-5-5 (was claude-3-7-sonnet-latest) metaculus/gpt-6-sol
summarizer / parser gpt-6-luna (was gpt-4o-mini) openrouter/anthropic/claude-haiku-5.5 anthropic/claude-haiku-5-5 (was claude-3-5-sonnet-20241022) metaculus/gpt-6-luna
researcher openai/gpt-5-search-api (was gpt-4o-search-preview) openrouter/perplexity/sonar-pro (gpt-4o-search-preview is no longer listed on OpenRouter) unchanged metaculus/gpt-5-search-api

gpt-6 models are created with temperature=None since they reject temperature.

Other changes

  • GeneralLlm default timeout table: added gpt-6 → 120s (same as gpt-5); without it the new defaults would fall back to 60s
  • MainBot summarizer, SmartSearcher, DataAnalyzer, TopicGenerator, intervention-testing policy agent and resolver defaults
  • Chat and CSV agent model pickers: openai/gpt-4.1 + gpt-4o replaced by openai/gpt-6-sol
  • template_bot_2026_fall.py example llms (and example timeout 40 → 160s for a reasoning model)
  • template_bot_2026_fall.py EXAMPLE_QUESTIONS now use bot-testing-area questions, and a date question was added
  • README.md / README.ipynb examples

Testing

  • Unit tests pass
  • Every new model id returned a response on its route (OpenAI, Anthropic, OpenRouter); gpt-4o-search-preview is absent from OpenRouter's model list
  • TemplateBot() with no llms on the OpenRouter route forecast binary, multiple choice and numeric example questions end to end
  • The new example question URLs resolve to binary, numeric, multiple choice, discrete and date questions
  • Metaculus proxy routes could not be verified: llm-proxy.metaculus.com does not currently resolve

🤖 Generated with Claude Code

CodexVeritas and others added 2 commits October 24, 2026 09:03
OpenAI retires gpt-4o, gpt-4o-mini, gpt-4.1 and gpt-4.1-mini on Jan 14th 2027. Default forecasting llms move to gpt-6-sol, small-model uses to gpt-6-luna (OpenAI routes) or Claude Haiku 5.5 (OpenRouter/Anthropic routes). Also replaces the gpt-4o-search-preview default researcher and the Claude 3.x defaults on the Anthropic route.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Adds a date question so every forecastable type is covered.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@CodexVeritas
CodexVeritas merged commit d3191d1 into main Oct 26, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant