Solved Guide | Search Suggestion URL

ukanuk

@baris-sehri said in Search Suggestion URL:

I couldn't find suggest urls for swisscows, metager, reddit and steam. is it possible to add them?

Suggest URLs don't generally seem to be officially published, which is why I started the table above to collect suggest URLs into one place. If you find a URL, please post it in this thread and I'll add it to my table!

Metager isn't providing me any search suggestions even from their homepage, so I doubt they have any suggestion service at all. But they have clear contact info on their website, so you could try contacting them. If they tell you something, share it and I'll add it to the table!

Steam, reddit, and swisscows do have search suggestions on their homepage, but I can't find any suggest URLs for steam or swisscows. Again, if you find something, share it and I'll add it to the table!

For reddit, I found they have several APIs which provide information potentially useful for suggest URLs:

/search, example results for "dog"
/api/recommend/sr/srnames, deprecated
/api/search_reddit_names, example results for "dog" (also works with POST apparently)
/api/search_subreddits, example results for "dog" but only works with POST
/api/subreddit_autocomplete, example results for "dog"
/api/subreddit_autocomplete_v2, example results for "dog"
/subreddits/search, example results for "dog"
/users/search, example results for "dog"

However, Vivaldi does not understand the format of any of these, not even the simplest one https://www.reddit.com/api/search_reddit_names.json?query=%s. This is the same issue as with Yahoo, Google Play, and the Merriam-Webster Dictionary and Thesaurus, which all have suggest URLs but don't work with Vivaldi. It would be awesome if Vivaldi extended the search engines to allow users to add custom scripting to parse the results from new suggest URLs, but that could also be a security flaw, I don't know.

So in the end, if suggestions for these engines are important to you, I recommend following the advice from @baris-sehri to use one of the suggest URLs I found above from Bing, Google, or another free engine.

baris.sehri

@derDay yes I do. I have suggest urls for some other engines, I just wanted to have for those too that's all... @ukanuk reddit suggest url didn't work for me I have suggest urls working for duck duck go, ecosia, youtube, startpage, bing and wikipedia. I'm not using google suggestions...

stardepp

Is there anyone who can create a search suggestion URL for Deezer? Here is the search URL:

https://www.deezer.com/search/%s

ukanuk

I'm not very familiar with this stuff, but it looks like we may be able to use a URL like https://www.deezer.com/ajax/gw-light.php?method=search_getSuggestedQueries if we could add the search parameter to it with POST with format {QUERY: "%s"}

I tried doing some of the stuff in these answers, but didn't really get anywhere https://stackoverflow.com/questions/4797534/how-to-manually-send-http-post-requests-from-firefox-or-chrome-browser.

Here's my attempt in Windows command line to get valid results:

curl -i -X POST -H "Content-Type: application/json" -d "{\"QUERY\": \"stuffff\"}" "https://www.deezer.com/ajax/gw-light.php?method=search_getSuggestedQueries"

I kept getting API / CSRF token errors though, which I don't understand how to interpret:

bizarro

@baris-sehri said in Guide | Search Suggestion URL:

can anyone help me with providing suggest links for some searches? I couldn't find suggest urls for swisscows, metager, reddit and steam. is it possible to add them?

I've just found the Swisscows suggest URL (the region and itemsCount parameters appear to be optional):
https://swisscows.com/api/suggest?query=%s&region=en-US&itemsCount=5

Hoever, it doesn't work! Because probably Vivaldi doesn't like the JSON list format returned, which is a simple list... For example, for the word "avoid", the URL:
https://swisscows.com/api/suggest?query=avoid&region=en-US&itemsCount=5
returns:

["avoid","avoid synonym","avoidant personality disorder","avoidance","avoided"]

For comparison, the Ecosia URL:
https://ac.ecosia.org/autocomplete?q=avoid&type=list
returns a similar list but mapped to the search term inside another list:

["avoid",["avoid","avoid synonym","avoidance","avoiding","avoid to or ing","avoided"]]

And Bing returns something similar (a list inside a list). So it seems that Vivaldi doesn't expect the simple list format provided by Swisscows, so it fails to extract the suggested words from that.

I wonder if it could be easily fixed in Vivaldi... (I would be very grateful if it were!)

Pathduck

@bizarro Hello and Welcome to the Vivaldi Community

Yeah, it won't work like that unfortunately. I believe Vivaldi uses the OpenSearch spec for suggestions, and any site breaking the spec won't work. Unfortunately OpenSearch seems to be a "dead" project now, and a lot of sites just ignore the spec and implement their own take.

I was able to find some doc:
https://web.archive.org/web/20190126144355/http://www.opensearch.org/Specifications/OpenSearch/Extensions/Suggestions/1.1#JSON-formatted_search_suggestion_responses

https://github.com/dewitt/opensearch/blob/master/mediawiki/Specifications/OpenSearch/Extensions/Suggestions/1.1/Draft 1.wiki

According to that, the Suggestion Prefix is a required value.

But yeah I agree that maybe Vivaldi should be more forgiving in cases like this. I guess you could always report a bug and hope for the best
https://help.vivaldi.com/desktop/troubleshoot/reporting-a-bug-in-vivaldi/

ukanuk

@bizarro Thanks, I've updated my table above! I also added to a bunch of the entries, to help illustrate this is a more widespread problem than with just Swisscows.

It looks like suggest URLs exist but aren't supported by Vivaldi for 7 different engines I've added -- Yahoo, Google Play, Merriam-Webster Dictionary, Merriam-Webster Thesaurus, Reddit, Swisscows, and Wolfram|Alpha.

ukanuk

@luetage, @QuHno, and @Pathduck shared some really helpful info about POST queries. Unfortunately I still wasn't able to create a query for Deezer.

luetage

@ukanuk Post a link to the search? Deezer seems to be some kind of music portal you need an account to access… so you might be on your own until someone with access comes along.

ukanuk

@luetage you can register on Deezer for free, but you don't actually need any account just to search and see suggestions automatically appearing as you type in their search bar. The search URL is https://www.deezer.com/search/%s, an example search is https://www.deezer.com/search/stuff, but we are having trouble finding/creating the suggest URL.

See these previous posts, https://forum.vivaldi.net/post/530664 where you @stardepp originally asks about it and https://forum.vivaldi.net/post/560897 where I make an initial investigation and find the POST request but don't know how to convert it into a GET request.

Here's Deezer without being logged in, and suggestions appearing:
Screenshot_20220806-112922_Vivaldi Browser.jpg

luetage

@ukanuk Oh, it’s about suggest urls… that’s something different. I always delete those and never enter them, so I have zero experience. Can’t help you there.

Pathduck

@ukanuk Yeah, suggestions not going to work for that one I'm afraid.

First of all, suggestions from the site search field uses POST and an API token, usually this is to avoid "abuse" from outside requests:

Request URL: https://www.deezer.com/ajax/gw-light.php?method=search_getSuggestedQueries&input=3&api_version=1.0&api_token=p4bCVtDQq8wuYexil0T2QeH1SGQCD12L&cid=92442938
Request Method: POST

Search results are not in a format Vivaldi can use (custom JSON, not OpenSearch standard):

{"error":[],"results":{"SUGGESTION":[{"QUERY":"The Afghan Whigs","HIGHLIGHT":"The Afghan Whigs"},{"QUERY":"the afghan whigs","HIGHLIGHT":"the afghan whigs"},{"QUERY":"the afghan whigs \u2013 congregation","HIGHLIGHT":"the afghan whigs \u2013 congregation"},{"QUERY":"the afghan whigs \u2013 a line of shots","HIGHLIGHT":"the afghan whigs \u2013 a line of shots"},{"QUERY":"the afghan whigs \u2013 algiers","HIGHLIGHT":"the afghan whigs \u2013 algiers"},{"QUERY":"the afghan whigs \u2013 gentlemen","HIGHLIGHT":"the afghan whigs \u2013 gentlemen"},{"QUERY":"the afghan whigs \u2013 do to the beast","HIGHLIGHT":"the afghan whigs \u2013 do to the beast"},{"QUERY":"the afghan whigs \u2013 my curse","HIGHLIGHT":"the afghan whigs \u2013 my curse"},{"QUERY":"the afghan whigs \u2013 if i were going","HIGHLIGHT":"the afghan whigs \u2013 if i were going"},{"QUERY":"the afghan whigs \u2013 in spades","HIGHLIGHT":"the afghan whigs \u2013 in spades"}],"HISTORY":[]}}

For those engines I just copy the DDG search suggestion URL, works fine as a workaround.

wudini

Suggestions for startpage don't work anymote, here is the new URL.

https://www.startpage.com/suggestions?q=%s&segment=startpage.vivaldi&format=json

ukanuk

@wudini Updated the table, thank you!

stardepp

Neeva search engine:

Search URL:

https://neeva.com/search?q=%s

Search Suggestion URL:

https://neeva.com/suggest?q=%s&src=opensearch&pk_source=vivaldi&pk_medium=external_product&pk_campaign=neeva_vivaldi_o

https://neeva.com

JonesBones

Couple others that I do not see mentioned. Neeva looks very interesting by the way.

1 - Brave - https://search.brave.com

Search

https://search.brave.com/search?q=%s

Suggestion

https://search.brave.com/api/suggest?q=%s

2 - mojeek - https://mojeek.com

Search

https://www.mojeek.com/search?q=%s

Engine has no suggestions

3 - https://you.com

Search

https://you.com/search?q=%s

Suggestion

https://you.com/api/ac?q=%s

4 - searchcode - https://searchcode.com/

Search

https://searchcode.com/?q=%s

Engine has no suggestions

5 - Openverse (formerly CC Search) - https://wordpress.org/openverse/

Search

https://search-production.openverse.engineering/search/?q=%s

Engine has no suggestions

ukanuk

Can anyone find suggest URLs for mojeek, searchcode, or Openverse (formerly CC Search)?

@JonesBones Thank you! I've added Brave and You to the table above with your suggest URLs, albeit I used https://you.com/search?q=%s&utm_source=vivaldi_browser instead of https://you.com/search?q=%s to help support Vivildi's revenue stream.

There's already a great existing pinned guide post by @stardepp at Guide | Vivaldi search engines collection for sharing search engines in general. My table above is only special for including every suggest URL I can find, and search engines I personally use (see "Inclusion Critera" in my post).

Pathduck

@ukanuk said in Guide | Search Suggestion URL:

Can anyone find suggest URLs for mojeek, searchcode, or Openverse (formerly CC Search)?

There are none
Just use DDG or whatever functioning suggestions string you want.

stardepp

pranjalKumar

@ukanuk
Thank you
It really helped me solve most of my advanced queries🦚