Solved Guide | Search Suggestion URL

mib2berlin

@geek4hire62511
Hi, I test this with the Google page itself and even Google cant find files on my Google drive set to public.
Or do I not understand your question?

Cheers, mib

Pathduck

@geek4hire62511 Should be as simple as:
https://drive.google.com/drive/search?q=%s

Since it seems to use GET it shows up in the url so easy to make into a search engine.

You're not going to get search suggestions working.

Pathduck

@geek4hire62511 Ah yeah, missed that

If the site does not support the OpenSearch standard for suggestions, it's not possible.

Usually you can check this yourself by looking at the page source.
There should be a link element with a type of application/opensearchdescription+xml pointing to an XML file.

Interestingly, Google Drive does have an OS XML - but no suggest URL.
https://drive.google.com/opensearch.xml

<?xml version="1.0" encoding="UTF-8"?>
<OpenSearchDescription xmlns="http://a9.com/-/spec/opensearch/1.1/">
	<ShortName>Google Drive</ShortName><LongName>Google Drive</LongName><Description>Search the contents of your Google Drive.</Description>
	<Url type="text/html" method="get" template="https://drive.google.com/drive/search?q={searchTerms}"/>
	<InputEncoding>UTF-8</InputEncoding>
	<Image height="16" width="16" type="image/png">https://ssl.gstatic.com/docs/doclist/images/infinite_arrow_favicon_4.ico</Image>
</OpenSearchDescription>

Compare to for instance Ecosia:
https://cdn-static.ecosia.org/static/opensearch.xml

<OpenSearchDescription xmlns="http://a9.com/-/spec/opensearch/1.1/">
	<ShortName>Ecosia</ShortName>
	<Description>Search Ecosia</Description>
	<InputEncoding>UTF-8</InputEncoding>
	<Contact>[email protected]</Contact>
	<LongName>Ecosia Search</LongName>
	<Image width="16" height="16"> data:image/x-icon;base64,AAABAAMAEBAAAAE...AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA </Image>
	<Url type="text/html" method="get" template="https://www.ecosia.org/search?q={searchTerms}&addon=opensearch"/>
	<Url type="application/x-suggestions+json" template="https://ac.ecosia.org/autocomplete?q={searchTerms}&type=list"/>
</OpenSearchDescription>

This can be tested with curl for instance:

$ curl "https://ac.ecosia.org/autocomplete?q=test&type=list"
["test",["test","testosterone","testing","test microphone","testament","testout","testbook","testicular cancer"]]

For more on OpenSearch:
https://en.wikipedia.org/wiki/OpenSearch
https://developer.mozilla.org/en-US/docs/Web/OpenSearch

That's the beauty of open standards; you can use it to figure out how to add search engines (and suggestions if supported) yourself

Alternatively, one can use Devtools to examine outgoing requests, for instance if the site uses POST for suggestions and create your URL from that. But won't work everywhere.

Pathduck

@geek4hire62511 What page? This forum? Some sites use fancy JS instead of proper HTML forms I guess.

OSD file is here:
https://forum.vivaldi.net/osd.xml

Of course anything that submits data can be used as a "search engine" in Vivaldi. URL shorteners, Translators, basically anything that has an input argument and produces some output.

Pathduck

@geek4hire62511 That site works just like the Gdrive one, you perform a search, look at the resulting URL and replace your search term with %s.
https://explainshell.com/explain?cmd=%s

It's got a pretty standard form that calls /explain with the cmd as argument.

<form action='/explain' method="get">
  <input id='explain' class="span10" type="text" name="cmd" autocapitalize="off" autocorrect="off"></input>
  <button class="btn" type="submit">EXPLAIN</button>
</form>

Again, you don't need to understand how the site does the search to add as a search engine. Just look at the resulting URL.

Barruel

@ukanuk said in Guide | Search Suggestion URL:

Several suggest URLs exist, but none currently work with Vivaldi

y

Yahoo!

• ~~http://sugg.search.yahoo.net/sg/?output=jsonp&nresults=10&command=%s~~
• ~~http://sugg.search.yahoo.net/sg/?output=json&nresults=10&command=%~~
• ~~http://sugg.search.yahoo.net/sg/?output=xml&nresults=10&command=%s~~

https://us.search.yahoo.com/yhs/search?hspart=iry&hsimp=yhs-fullyhosted_009&type=dpp_vvldnu_00_00&param1=1&param2=pa%3Ddowncoll%26b%3DVivaldi&p=%s
• [Obsolete] This URL was the previous official version (I noticed the change in 4.3.2439.63, but it probably happened earlier):
•~~https://us.search.yahoo.com/yhs/search?hspart=iry&hsimp=yhs-fullyhosted_009&type=dpp_vvldnu_00_00&param1=1&param2=pa%3Ddowncoll&p=%s~~

Hello.

Got Yahoo! suggestions working nicely.

URL:

https://search.yahoo.com/search?p=%s&ei=UTF-8&guccounter=1

Suggest URL:

https://ff.search.yahoo.com/gossip?output=fxjson&command=%s

I've got it looking at PaleMoon headers. PM is actually a quite old Firefox, so that "ff" at the beginning of the url is targeting it and Vivaldi happily understands the string sent to it:

curl "https://ff.search.yahoo.com/gossip?output=fxjson&command=testword"
["testword",["typing test words per minute","spelling test words","pacer test words","typing speed test words per minute","test words per minute","practice typing test words per minute","free online typing test words per minute","free typing test words per minute","online typing test words per minute","test word"],[],[]]

It's noteworthy that

https://search.yahoo.com/gossip?output=fxjson&command=%s"

throws a 404 error, but

https://ff.search.yahoo.com/gossip?command=%s"

sends the correct reply when using curl, but Vivaldi doesn't show the suggestions if the "output=fxjson" part of the string is missing.

Pathduck

@Barruel Good finding!

It's a big problem with these search engines - no OpenSearch definitions and we have to guess from the basics to try and find a working suggest url. Especially with st00pid sites like Yahoo thinking OpenSearch = Firefox ... - no, it's a standard they should follow...

With a bit of tweaking and a web search I found another working url:
https://search.yahoo.com/sugg/ff?output=fxjson&command=%s

$ curl "https://search.yahoo.com/sugg/ff?output=fxjson&command=test"
["test",["test internet speed","test keyboard","testosterone","test book","test mic","test camera","testicular cancer","test microphone","testosterone supplements","test key"],[],[]]

This has the advantage it can be used for language-specific results:

$ curl "https://no.search.yahoo.com/sugg/ff?output=fxjson&command=test"
["test",["test","testosteron","test internet speed","test mobiltelefoner","test-in-prod","testament","testikkelkreft","test vinterdekk","test pinnekjøtt","test varmepumper"],[],[]]

$ curl "https://de.search.yahoo.com/sugg/ff?output=fxjson&command=test"
["test",["test","teste dich","testberichte","testament","testosteron","testzentrum","test digitalkameras","test navigationsgeräte","test kaffeevollautomat","test smartphones"],[],[]]

$ curl "https://se.search.yahoo.com/sugg/ff?output=fxjson&command=test"
["test",["test","testamente","testosteron","test mobiltelefoner","test dammsugare","test robotgräsklippare","test vinterdäck","test kaffebryggare","test tvättmaskiner","testikelcancer"],[],[]]

We don't know how long ff.search.yahoo.com will exist. Then again we don't know how long they will continue supporting "ffjson" as a format.

Then again, I don't use Yahoo as it sucks as a search engine

Barruel

@Pathduck said in Guide | Search Suggestion URL:

With a bit of tweaking and a web search I found another working url:
https://search.yahoo.com/sugg/ff?output=fxjson&command=%s

Very nice. How did you find it? I find these little tricks very interesting.

We don't know how long ff.search.yahoo.com will exist. Then again we don't know how long they will continue supporting "ffjson" as a format.

Apparently OpenSearch is not a very successful standard. I'm sure that by then Vivaldi devs would have placed a nice "Regular expression parsing string" field next to the "Suggest URL" field.

Pathduck

@Barruel I did a Google search for yahoo fxjson and a little down I found this:
https://github.com/Keypirinha/Keypirinha/issues/189
Under "[predefined_provider/Yahoo]"

Then modified that a bit by guesswork

Lots of people complaining in the results as well that Yahoo results are no longer in Firefox

Keypirinha seems like an interesting project, you never know what you'll find when searching

ukanuk

@Barruel @Pathduck thank you for the contributions, added to the table above!

coromd

Is the Amazon suggestURL broken? I can't seem to make it work. Vivaldi 6.1.3035.302

ukanuk

@coromd Yeah seems broken for me too unfortunately. Testing it with https://completion.amazon.com/search/complete?method=completion&search-alias=aps&client=amazon-search-ui&mkt=1&q=kne returns a 410 error.

I found the updated URL https://completion.amazon.com/api/2017/suggestions?mid=ATVPDKIKX0DER&alias=aps&prefix=%s at https://github.com/philc/vimium/blob/master/background_scripts/completion_engines.js, and testing for example https://completion.amazon.com/api/2017/suggestions?mid=ATVPDKIKX0DER&alias=aps&prefix=kne returns valid results. But it looks like a suggest URL which Vivaldi does not currently support

If you find something still working, please let me know and I'll update the table.

pranjalKumar

@ukanuk I am a CS undergrad student and I got to say that Custom Search Engine with these URL's have definitely boosted my productivity.
With these its much easier to search anything on YouTube or Wiki. I have also created custom for my all mails. So its even easier to search for my mails.

ukanuk

@pranjalKumar Awesome, glad to hear it! Have you tried out vimium? I find the f and hjkl scrolling extremely useful as well. Although if you don't use vim you might not appreciate hjkl, I still think the f navigation is useful to everyone. Similar to Vivaldi's Spatial Navigation but imo much quicker and more exact.

stardepp

Does anyone know a current valid search suggestion URL for Youtube?

These no longer work:

https://suggestqueries.google.com/complete/search?client=firefox&ds=yt&q=%s

https://www.google.com/complete/search?client=chrome&ds=yt&q=%s

https://www.google.ru/complete/search?hl=ru&ds=yt&output=firefox&q=%s

Pesala

@stardepp This works for me. I have used it for ages. Nothing has changed recently.

https://www.youtube.com/results?search_query=%s

stardepp

@Pesala I need the Search Suggestion URL: What you have shown me is the normal search URL.

oudstand

@stardepp I use this one and it works:
https://www.google.de/complete/search?hl=de&ds=yt&output=chrome&q=%s

mib3berlin

@oudstand
Hi, this is the standard Google search suggestion URL but it seems the results are the same in Youtube search bar.
Interesting, I would have thought that it is different.

Cheers, mib

oudstand

@mib3berlin Is the ds=yt part also from the default google search suggestion URL?