Skip to the page

GPT Researcher

Google PSE stops on Jan 1, 2027. The setting to change.

GPT Researcher's google retriever calls Google's Custom Search JSON API with GOOGLE_API_KEY and GOOGLE_CX_KEY. Google closed that API to new customers and ends it on January 1, 2027, and the retriever fixes its address in code.

Change two variables: RETRIEVER=searx and SEARX_URL=https://api.specstream.ai/searxng/YOUR_KEY. Or set RETRIEVER=serper with SERPER_API_BASE=https://api.specstream.ai/serper. Both passed our test.

SpecStream scores 97.9 F-score on all 1,000 SimpleQA Verified questions and 64.0 item F1 on all 200 WideSearch tasks, at $5 per 1,000 searches. A new account gets $10 of credit, no card.

New accounts get $10 of credit, no card. It covers 2,000 searches.

GPT Researcher's Google retriever and what replaces it, from each company's own pages on Nov 10, 2026

SpecStreamGoogleTavilySerper
RETRIEVER and addresssearx with SEARX_URL, or serper with SERPER_API_BASE, both pointed at api.specstream.aigoogle. The address is fixed in GPT Researcher's code at www.googleapis.com/customsearch/v1tavily, the default. The address is fixed in GPT Researcher's code at api.tavily.com/searchserper. SERPER_API_BASE defaults to https://google.serper.dev
Open to a new accountYes. Create a key and start with $10 of credit, no cardNo. The Custom Search JSON API is closed to new customersYes, with 1,000 free credits every monthYes, with 2,500 free queries
Price per 1,000 searches$5, with up to 10 results a search$5 per 1,000 queries after 100 free queries a day, for existing customers only$0.008 a credit on pay as you go. A basic search is 1 credit and an advanced search 2$1.00 per 1,000 in the pack of 50,000 credits
LimitNo daily limit. Up to 8,800 searches a minute on one account10,000 queries a dayOn a monthly plan, requests stop when the month's credits run out300 queries per second on the largest pack
How long it lastsCredit you buy never expiresExisting customers have until January 1, 2027Credits reset on the first day of each monthCredits are valid for 6 months
What answers the searchThe whole live web, read at the moment of the call. 97.9 F-score on all 1,000 SimpleQA Verified questions, 978 correctThe Programmable Search Engine you configuredTavily's search. Its own post reports 97.6% on SimpleQASerper's search, bought in credit packs from 50,000 credits

Why GPT Researcher users move the Google retriever to SpecStream

Other Google PSE alternatives for GPT Researcher

How SpecStream scores

The same numbers as the benchmarks page, from the official tasks and scorers.

How to move GPT Researcher from Google to SpecStream

1. Create a key under Agents & API in the SpecStream workspace. A new account gets $10 of credit, no card, which covers 2,000 searches.

2. In GPT Researcher's .env, replace RETRIEVER=google, GOOGLE_API_KEY and GOOGLE_CX_KEY with the retriever and its address.

RETRIEVER=searx
SEARX_URL=https://api.specstream.ai/searxng/YOUR_SPECSTREAM_KEY

3. Check the key with the call the retriever sends. A 200 with results means GPT Researcher gets the same.

curl "https://api.specstream.ai/searxng/$SPECSTREAM_API_KEY/search?q=test&format=json"

4. Run a research task as you do today. Each search shows up in your SpecStream request log with its price.

Frequently asked questions

Something we didn't answer? Talk to a human

Why is the Google retriever not working in GPT Researcher?
Google closed the Custom Search JSON API to new customers and ends it on January 1, 2027. The retriever prints Google search: unexpected response status: and returns no results. Set RETRIEVER=searx with SEARX_URL at SpecStream and the sources come back.
What is the best Google PSE alternative for GPT Researcher?
SpecStream, with 97.9 F-score on all 1,000 SimpleQA Verified questions and 64.0 item F1 on all 200 WideSearch tasks, at $5 per 1,000 searches. It runs through the searx and serper retrievers with no code change.
Can I change the Google address in GPT Researcher?
No. google.py fixes the address at https://www.googleapis.com/customsearch/v1. The searx retriever reads SEARX_URL and the serper retriever reads SERPER_API_BASE, and SpecStream answers both.
What replaces GOOGLE_API_KEY and GOOGLE_CX_KEY?
Two lines: RETRIEVER=searx and SEARX_URL=https://api.specstream.ai/searxng/YOUR_SPECSTREAM_KEY. There is no engine ID, because SpecStream searches the whole live web.
How much does a GPT Researcher run cost on SpecStream?
$0.005 for each search of up to 10 results, so a run of 40 searches costs $0.20. A new account gets $10 of credit, no card, and spend_cap_cents on the key caps what it can spend.
Is Google Custom Search shutting down?
Yes, on January 1, 2027 for existing customers, and it is already closed to new customers. Google names Vertex AI Search for up to 50 domains.

Sources

SpecStream wrote this page. GPT Researcher's settings come from its source on GitHub, and each provider's figure from that company's own page.

  1. GPT Researcher Google retriever, google.pygithub.com/assafelovic/gpt-researcher/blob/main/gpt_researcher/retrievers/google/google.py, read Nov 10, 2026
  2. GPT Researcher searx retriever, searx.pygithub.com/assafelovic/gpt-researcher/blob/main/gpt_researcher/retrievers/searx/searx.py, read Nov 10, 2026
  3. GPT Researcher serper retriever, serper.pygithub.com/assafelovic/gpt-researcher/blob/main/gpt_researcher/retrievers/serper/serper.py, read Nov 10, 2026
  4. GPT Researcher tavily retriever, tavily_search.pygithub.com/assafelovic/gpt-researcher/blob/main/gpt_researcher/retrievers/tavily/tavily_search.py, read Nov 10, 2026
  5. GPT Researcher default configgithub.com/assafelovic/gpt-researcher/blob/main/gpt_researcher/config/variables/default.py, read Nov 10, 2026
  6. Google Custom Search JSON API overviewdevelopers.google.com/custom-search/v1/overview, read Nov 10, 2026
  7. Vertex AI Search pricingcloud.google.com/generative-ai-app-builder/pricing, read Nov 10, 2026
  8. Tavily API creditsdocs.tavily.com/documentation/api-credits.md, read Nov 10, 2026
  9. Tavily pricingtavily.com/pricing, read Nov 10, 2026
  10. Tavily, SealQA and SimpleQA posttavily.com/blog/tavily-ranks-1-on-sealqa-and-simpleqa, read Nov 10, 2026
  11. Serperserper.dev/, read Nov 10, 2026
  12. SpecStream benchmarksspecstream.ai/benchmarks, read Nov 10, 2026
  13. SpecStream pricingspecstream.ai/pricing, read Nov 10, 2026
  14. SpecStream for agentsspecstream.ai/agents.md, read Nov 10, 2026