Link-based filtering of repeated feed items
-
It's been discussed many times before, but as mentioned in this snapshot thread somehow there's a significant probem with the feed reader which never appears on the devs' radar: many (in my case the majority) of feeds from popular news websites will repopulate the feed index with the same news story every time the feed address is polled.
It was suggested that the site may issue new index numbers with every update to the feed - which seems likely - but considering the link addresses remain the same I would like to request an option to activate some kind of address-based filter to hide the hundreds of duplicates I have to delete daily.
I think the link address would be the most reliable method of filtering as I've noticed some websites may subtly alter the title headline of an article a few times during a day.
-
A few years ago I remember I had a problem with some news websites that provided feeds by category (news, sports, economy, highlights, etc). Sometimes the same news would show up on more than one feed and I had to keep deleting it multiple times.
I haven't subscribed to such feeds with Vivaldi yet, so I can't say I've experienced it yet...Anyway, to improve the chances someone can replicate your problem:
- Can you give an example of such feeds?
- Does the same problem happen with other feed readers or only Vivaldi?
-
@pauloaguia said in Link-based filtering of repeated feed items:
Anyway, to improve the chances someone can replicate your problem:
- Can you give an example of such feeds?
As mentioned in the thread I linked to, here are three sites which I know can easily be tested:
BBC News (very very old feed (help page is from 2011!) :
https://www.bbc.co.uk/news/10628494
e.g. http://feeds.bbci.co.uk/news/world/rss.xmlThe Guardian, they have an unusual RSS generator which seems to make a feed of any page by adding "/rss" to the address (possible connection to why it generates floods of articles?), e.g.:
https://www.theguardian.com/world/rssPitpass F1 motorsport news (has a tendency to reload the same articles again the next day):
https://www.pitpass.com/fes_php/fes_usr_sit_newsfeed.php?fes_prepend_aty_sht_name=1On the other hand, Expatica feeds shows articles when I subscribe to them but then almost never after that!
https://www.expatica.com/fr/feed/?post_type=post- Does the same problem happen with other feed readers or only Vivaldi?
I am comparing with my previous use of Opera 12 where IIRC there was some repetition of the old BBC feeds but not as bad as I see in Vivaldi. As @ybjrepnfr says in the linked thread:
@daniel said in Same old New Window now opens faster – Vivaldi Browser snapshot 3062.3:
most often just a matter of the website having changed their IDs when they’re not supposed to
others have also said this before, but with respect, this does not ring true to me, because i do not only use vivaldi... in my non-chromium browser, with the feedbro addon, for the same channel example i posted earlier, none of those duplicates occur.
-
@mossman
you can add youtube and https://www.heise.de/rss/heise-atom.xml to this (faulty) list -
@mossman said in Link-based filtering of repeated feed items:
repopulate the feed index with the same news story every time the feed address is polled
i second [or third, fourth, whatevs] this irritating long-term bug, but would slightly finesse its symptom description in my case. i cannot say that it is every site & every poll, instead it just seems utterly random. sometimes i can go days or longer with it behaving, yet other times it just won't stop happening. also, i deliberately use the pejorative "necro-fetching" coz numerous times it's actually ancient items it goes & re-fetches, not only recent items. in my use-case anyway, it's nice when it behaves, but much of the time is just a damn PITA.
Look, you've got it all wrong! You don't need to follow me. You don't need to follow anybody! You've got to think for yourselves! You're all individuals!
-
@derDay said in Link-based filtering of repeated feed items:
@mossman
you can add youtube and https://www.heise.de/rss/heise-atom.xml to this (faulty) list
I can add a lot more to that list, believe me. I just picked a couple of the more high profile websites I use and one which is less high profile. -
@ybjrepnfr said in Link-based filtering of repeated feed items:
@mossman said in Link-based filtering of repeated feed items:
repopulate the feed index with the same news story every time the feed address is polled
i second [or third, fourth, whatevs] this irritating long-term bug, but would slightly finesse its symptom description in my case. i cannot say that it is every site & every poll, instead it just seems utterly random. sometimes i can go days or longer with it behaving, yet other times it just won't stop happening. also, i deliberately use the pejorative "necro-fetching" coz numerous times it's actually ancient items it goes & re-fetches, not only recent items. in my use-case anyway, it's nice when it behaves, but much of the time is just a damn PITA.
True - I shouldn't have implied that 100% of available articles are fetched 100% of the time.
For devs' reference, the Guardian news pages seem to repeat the most often in my experience.
