dimanche 4 janvier 2015

Wget: convert-links and avoid redownloading already fetched files?


I am downloading data spread among multiple files that don't change once published.


Therefore --timestamping is not good enough, because it is constantly checking whatever resource is changed, which is, in my case, completely pointless.


--no-clobber would fit perfectly. Unfortunately it doesn't work with --convert-links for some reason.



Both --no-clobber and --convert-links were specified, only --convert-links will be used.



I hoped that --backup-converted would help but it changed nothing (it works for --timestamping.)


Why wget --convert-links --backup-converted --no-clobber --wait 1 https://example.com ignores --no-clobber and how could it be fixed?



Aucun commentaire:

Enregistrer un commentaire