Duplicated bookmark detection / cleanup
-
It should be fairly easy to parse bookmarks.html to create a text file for each entry (and also recreate the same folder structure). Then, any old duplicate file finder program could be used. (I usually use Ashisoft's. (semi-relevant shoutout to WinMerge and Directory Opus' flat view. (marginally-relevant shoutout to VisiPics and Bulk Rename Utility) - whoop whoop)) You'd delete the dupes using your app of choice, then a function would merge the contents of all the remaining text files back into a single HTML file (the inverse of the first function) which could then be imported back into Vivaldi (after deleting your bookmarks.adr file (after you make a backup (quasi-related shoutout to SyncBackPro (the free version is great too, but you can only copy, not move, files))).
Slightly convoluted, but I think it might save a lot of coding time, not having to duplicate the duplicate checking code...
Perhaps I'll tackle this as one of my first programming tasks... It really doesn't sound too difficult... (but don't hold your breath...)
-
If this feature gets implemented, please don't just auto-remove the links. I would like to review the duplicates and broken links first before they get deleted.
-
additionally grouping by host in bookmarks would be nice, like the current functionality in tab stacks
-
I'm working on a little utility that reads the bookmarks, throws out all the duplicates and outputs a new Bookmarks file. I'll share it when it's ready.
I agree, though, that there should be such functionality present in either Vivaldi itself or in a web interface showing your sync data.
-
When implementing this feature, I would like to see a "duplicate" only be counted if they are in the same folder. A bookmark to the same page located in a different folder is not a duplicate to me. It is useful to be able to find the same page through different paths if desired.
For example, it's useful to have a page included in a folder of links I may share with someone, but also in my Speed Dial. It would not be good if the dedupe process deleted either of those.
But I am desperate for this feature. Especially since we do not have a mobile version of Vivaldi yet. I have to use another browser on my phone, use it to sync to my desktop version of that browser, then I export the bookmarks I've made on my phone and import them into Vivaldi where I then proceed to sort the folders where they belong.
Watching for this feature with baited breath. Signed up for this feature, and one other big bug report I'm about to start searching for.
-BoneTone
-
I need this badly . It doesn't seem like something that would be hard to implement.
-
@TheBinge said in Duplicated bookmark detection / cleanup:
I need this badly .
There are different extensions that do exactly this, try one, search for "chrome bookmark checker"
It doesn't seem like something that would be hard to implement.
try to code it yourself and see how many different problems you'll encounter while doing it.
-
I have to agree.
This Chromium format for bookmarking is Bass Ackwards in my opinion.Something that can easily be exported in a format to put into a database where users can do Counts, easily find duplicates, idendtify dupes and duplicate folders to merge non duplicates and for deletion of those items no longer needed.
Then clear all bookmarks (after backup) and import your work from the database.
A simple VBcript is all that is needed for the user to Find broken URLs.Used to be able to do this in FF and old Opera with SQlite FF Add-on but now the bookmarking files are so convoluted this is impossible.
-
@Martin-Storch said in Duplicated bookmark detection / cleanup:
If this feature gets implemented, please don't just auto-remove the links. I would like to review the duplicates and broken links first before they get deleted.
I prefer this way too
-
we can add to the context menu two lines, one to close other duplicates of the current tab, and the other to close all duplicates of any tab.
-
I'm using AM-DeadLink to check it, but it doesn't delete them.
Is there any plan to implement something like a "link checker" and option to delete bad links down the line?
-
@yrvkon I use extension Bookmarks clean up
0.0.3, it has option to delete dead links but i haven't tried it yet -
<bump>
I'd love to have some way to automate cleaning my 20000 duplicated notes that appeared this week... -
@ROTFL said in Duplicated bookmark detection / cleanup:
<bump>
I'd love to have some way to automate cleaning my 20000 duplicated notes that appeared this week...A temporary workaround could be using some UI automation to do that. I know it's far from ideal, but better than manually doing it.
-
@bonetone I used to run Python script that I wrote especially for that but because notes sync is incomplete (without attachments) and clones have usually random attachments it is not so easy to find duplicates sometimes...
I just got tired with hunting clones every week and stopped using notes -
@ROTFL Yeah, I find OneNote to be superior to the built-in Notes Panel anyways. Plus, I've long been able to sync that with Android. So I prety much keep all my notes in that. Still running OneNote 2013 on Windows, but considering installing OneNote 2016. I definitely prefer those versions over the one included in Windows due to the maturity of the feature set. I think that the UWP version will approach parity eventually, just not yet.
After spending several years using and evaluating a plethora of note-taking software, I settled on OneNote as the best solution in terms of richness of formatting, elegance of organization, ease of sharing & synchronization, integration with other programs, and multiplatform support. Since then OneNote has only gotten better, and distanced itself further from the competition. To top it all off, it is free and available to pretty much everyone whether they use Windows, Linux, Mac, iPhone or Android.
I had a small number of notes in Vivaldi, ~25 or so, but as soon as I saw the duplication issue happen and having read the posts of people experiencing such large numbers of duplicates, I recently migrated them all into OneNote.
-
@ROTFL
Now that I think about it, it would probably be easier to write something that works on the data in the Notes file directly. Obviously work on a backup copy of the file... but the structure of the data should make it fairly easy to do.I just did a quick analysis of my Notes file, which currently does have at least 1 duplicate, and they have different IDs. Simply keep the one with the smallest ID number and delete all the other dupes.
-
- ID is just ID and means nothing but identifier. Sometimes creation date is more important but not always
- As I said problem is more complicated when you have partially synced attachments between computers and notes with random attachments and older versions of notes and other chaotic artifacts of a buggy sync...
-
Finally got the time to finish the tool I was working on, an initial version is published at https://github.com/kamenminkov/vivaldi-bookmarks-dedupe
Feedback is very welcome. The project contains a detailed readme, let me know if you think something is missing.Still figuring out the best way to do it as Vivaldi sometimes likes to still duplicate the bookmarks after syncing. Found out that renaming a folder that duplicates appear in, then letting that folder appear twice, then deleting the one with the duplicates kind of helps. Also found out that it's probably a good idea to reset sync, close the browser, copy the cleaned up bookmarks, then sign in again.
-
@killchain I'm definitely going to look at this in detail when I get a little time. I am also developing a bookmark management tool, so we could possibly help each other out with this.
