apt update in debian fails due file size mismatch

murmel

when trying to update packageinfo on a debian/testing:

root@h1:~# apt update

Hit:2 http://ftp.ch.debian.org/debian bookworm InRelease

Ign:1 https://repo.vivaldi.com/stable/deb stable InRelease

Get:3 https://repo.vivaldi.com/stable/deb stable Release [3,840 B]

Get:4 https://repo.vivaldi.com/stable/deb stable Release.gpg [833 B]

Get:5 https://repo.vivaldi.com/stable/deb stable/main amd64 Packages [1,154 B]

Ign:5 https://repo.vivaldi.com/stable/deb stable/main amd64 Packages

Err:5 http://repo.vivaldi.com/stable/deb stable/main amd64 Packages

  File has unexpected size (1573 != 1154). Mirror sync in progress? [IP: 151.101.193.91 443]

Err:5 http://repo.vivaldi.com/stable/deb stable/main amd64 Packages

  File has unexpected size (1573 != 1154). Mirror sync in progress? [IP: 151.101.193.91 443]

Fetched 833 B in 0s (1,781 B/s)

Reading package lists... Done

E: Failed to fetch http://repo.vivaldi.com/stable/deb/dists/stable/main/binary-amd64/Packages  File has unexpected size (1573 != 1154). Mirror sync in progress? [IP: 151.101.193.91 443]

E: Some index files failed to download. They have been ignored, or old ones used instead.

i get some strange file size errors.

installed version is:

ii  vivaldi-stable 5.4.2753.51-1 amd64

thanks for that great browser - well done

DoctorG

@murmel Update from 5.4.2753.51 to 5.5.2805.32 worked nice for me on Debian 11.5.

Perhaps the CDN is broken.

repo.vivaldi.com 
n.sni.global.fastly.net
199.232.189.91

And IP on your side?

murmel

root@h1:~# date && apt update

Wed  5 Oct 13:24:14 CEST 2022

Hit:2 http://ftp.ch.debian.org/debian bookworm InRelease

http://repo.vivaldi.com/stable/deb/dists/stable/main/binary-amd64/Packages  File has unexpected size (1573 != 1154). Mirror sync in progress? [IP: 151.101.65.91 443]

E: Some index files failed to download. They have been ignored, or old ones used instead.

murmel

/etc/apt/sources.list.d/vivaldi.list select:

deb [arch=amd64] http://repo.vivaldi.com/stable/deb/ stable main

as source (which comes from automatically after a "stable"-branch installation)

DoctorG

@murmel Same as on my Debian 11.

murmel

repo.vivaldi.com
n.sni.global.fastly.net 
151.101.1.91

murmel

this leads to a cloaked DNS.
sorry for inconvenience ...

murmel :|

murmel

once again ...
i have access to a different system as well - which uses vivaldi as well but this showes the same problem but with a different address:

root@host:~# apt update && apt upgrade

Get:2 http://security.debian.org testing-security InRelease [48.0 kB]

...

Err:12 http://repo.vivaldi.com/stable/deb stable/main amd64 Packages  

  File has unexpected size (1573 != 1154). Mirror sync in progress? [IP: 199.232.17.91 443]

Get:14 http://ftp.ch.debian.org/debian testing/main Translation-en T-2022-10-05-0803.13-F-2022-10-05-0803.13.pdiff [321 B]

Get:14 http://ftp.ch.debian.org/debian testing/main Translation-en T-2022-10-05-0803.13-F-2022-10-05-0803.13.pdiff [321 B]

Err:12 http://repo.vivaldi.com/stable/deb stable/main amd64 Packages              

  File has unexpected size (1573 != 1154). Mirror sync in progress? [IP: 199.232.17.91 443]

Fetched 347 kB in 2s (172 kB/s)                                                   

Reading package lists... Done

E: Failed to fetch http://repo.vivaldi.com/stable/deb/dists/stable/main/binary-amd64/Packages  File has unexpected size (1573 != 1154). Mirror sync in progress? [IP: 199.232.17.91 443]

E: Some index files failed to download. They have been ignored, or old ones used instead.

is this IP in your pool?

repo.vivaldi.com
n.sni.global.fastly.net
199.232.17.91

felagund

I have the same error. Those are outputs from dig? Mine is

repo.vivaldi.com. 99 IN CNAME n.sni.global.fastly.net.
n.sni.global.fastly.net. 19 IN A 199.232.17.91

Which is the same one as yours!

DoctorG

@felagund @murmel Perhaps a issue with routing?
I do not know which country or DNS or proxy/vpn you use.

felagund

I do not think it is a problem on my part. I am in Czechia, no VPN, DNS from my provider (the largest cable internet provider in the country).

But your suggestion inspired me to a fix - adding

199.232.189.91 repo.vivaldi.com

to /etc/resolv.conf fixes the issue.

But Vivaldi or their hosting provider should fix this, still:-).

DoctorG

@felagund @murmel Our Vivaldi server admin had reset the cache of the CDN, but seems that did not help you.

I try to ask in internal chat.

But your suggestion inspired me to a fix - adding
199.232.189.91 repo.vivaldi.com
to /etc/resolv.conf fixes the issue.

Yes, adding my mentioned IP to hosts file is a workaround.

thomasp

As @DoctorG mentioned, I flushed the cache for the Packages file yesterday, which should have refreshed it across the CDN.

Right now, testing with that file against the IP address that you were getting, I get results that seem absolutely fine:

$ curl -s -I --connect-to repo.vivaldi.com:443:151.101.193.91:443 https://repo.vivaldi.com/stable/deb/dists/stable/main/binary-amd64/Packages.gz | grep -i content-length
content-length: 1154

$ curl -s --connect-to repo.vivaldi.com:443:151.101.193.91:443 https://repo.vivaldi.com/stable/deb/dists/stable/main/binary-amd64/Packages.gz | wc -c
1154

As indicated by these results, the Content-length (1154) matches the file size of the downloaded file, so everything should be working just fine.

If you are still seeing the problem, please let us know.

felagund

I guess it is alright now. (apt update returns no errors). Either you did that reset just now or it took some time to propagate.

DoctorG

@felagund Had you tested without the patch of /etc/hosts … resolv.conf?

felagund

I think so:

dig repo.vivaldi.com

; <<>> DiG 9.18.1-1ubuntu1.2-Ubuntu <<>> repo.vivaldi.com
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 58901
;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 65494
;; QUESTION SECTION:
;repo.vivaldi.com. IN A

;; ANSWER SECTION:
repo.vivaldi.com. 300 IN CNAME n.sni.global.fastly.net.
n.sni.global.fastly.net. 12 IN A 199.232.17.91

murmel

removed repo.vivaldi.com from /etc/hosts

root@h1:~# dig repo.vivaldi.com
; <<>> DiG 9.18.7-1-Debian <<>> repo.vivaldi.com
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 35118
;; flags: qr rd ra; QUERY: 1, ANSWER: 5, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 4000
;; QUESTION SECTION:
;repo.vivaldi.com.		IN	A

;; ANSWER SECTION:
repo.vivaldi.com.	300	IN	CNAME	n.sni.global.fastly.net.
n.sni.global.fastly.net. 30	IN	A	151.101.1.91
n.sni.global.fastly.net. 30	IN	A	151.101.65.91
n.sni.global.fastly.net. 30	IN	A	151.101.129.91
n.sni.global.fastly.net. 30	IN	A	151.101.193.91

i would assume, that this will work now ...

tnx murmel