Solved Unable to Access Additional Pages of Site Search Results on Ecosia

[Pesala]

If I perform a site search on my website (http://www.aimwell.org), I can see the search results on the first page, but if I try to go to page 2 using the page link, I get this message, which never redirects.

[Pathduck]

For a search engine that's supposed to be "partnered" with Vivaldi, it sure is finnicky about who it allows to use it...

A quick cURL test, with header file:

cookie: cf_clearance=4cbitDTUJpAAIZKJe56sH.2WqCwpKpEntIsB5cISqjg-1666002008-0-150;
referer: https://www.ecosia.org/search?method=index&q=Lord%20site%3Aaimwell.org&p=0
user-agent: Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.0.0 Safari/537.36 Vivaldi/5.5.2805.38

Returns a 503 Service Unavailable

$ curl -IX GET -H @head.txt "https://www.ecosia.org/search?method=index&q=lord%20site%3Aaimwell.org&p=1"
HTTP/2 503

Removing Vivaldi from the user-agent returns a 200 OK:

$ curl -IX GET -H @head.txt "https://www.ecosia.org/search?method=index&q=lord%20site%3Aaimwell.org&p=1"
HTTP/2 200

Looks like way too aggressive UA sniffing from Cloudflare. But Ecosia is a customer of CF and they control the rules CF uses so it's their problem to sort.

Vivaldi uses its real UA string on Ecosia - apparently the Ecosia people tend to forget this...

[Pesala]

@Pathduck Thanks for your help.

I logged a bug report:

(VB-92440) Unable to Access Additional Pages of Site Search Results on Ecosia

[Pathduck]

@Pesala If you do the search using the engine:
e lord site:aimwell.org
It works, because Vivaldi sends the "client identifier" code: tt=dccf112d

But still it fails when going to the main page and doing the search from there since the code is not sent...