Skip to main content

All Questions

Tagged with
1 vote
1 answer
3k views

recursively wget in specific folder

I'm trying to get files from HTTP using wget command. I need every file in: http://9.9.9.9/a/b/c/d/ which is not a directory. I was trying it by: -A log,html,tgz,zip,txt,css,js In addition, ...
raptor0102's user avatar
3 votes
1 answer
2k views

making sense of wget -r output

This is the output of tree command in one directory: . |-- asdf.txt |-- asd.txt |-- fabc | |-- fbca | `-- file1.txt |-- fldr1 |-- fldr2 | `-- index.html |-- fldr3 | |-- cap.txt | `-- f01 `--...
deostroll's user avatar
  • 1,815
1 vote
2 answers
636 views

Why is entire website not downloaded?

I tried to make a copy of the site wiredhealthresources.net using the command: wget -rpkl inf wiredhealthresources.net But the command only downloaded 54 files! Most of the pages are missing, e.g. /...
Zaz's user avatar
  • 2,596
1 vote
1 answer
589 views

Wget having trouble just saving the files I want - exclude directories doesn't seem to work

I want to download all government spending over £500 by the Department of Energy and Climate change. These are .xls and .xlsx files, generated once per month. They are stored at locations like this: ...
baronmax's user avatar
5 votes
2 answers
14k views

wget - only getting .listing file in every sub-dir

if I use the command wget --no-remove-listing -P ...../debugdir/gnu/<dir>/ ftp:<ftp-site>/gnu/<dir>/ I will get the .listing file of that directory. But I have to step through ...
Frans's user avatar
  • 51
5 votes
3 answers
14k views

Recursive download of subfolder with wget - --no-parent apparently not working

I need some documentation about XUL but I do not have Internet access most of the time. So, I've tried to download the Mozilla Tutorial with the following command: wget --no-parent -r -l 2 -p -k ...
brandizzi's user avatar
  • 165
4 votes
1 answer
4k views

wget recursively with -np option still ascends to parent directory

tl;dr: will `wget --no-parrent -r ' download from a directory above the given url's directory? when using wget to download, say images, recursively from example.com/a/b with the -r and -np options, ...
vectra's user avatar
  • 51
0 votes
1 answer
321 views

wget: Turn Off Forced .html Retreival

When performing a recursive download, I specify a pattern via the -R parameter for wget to reject, but if this file is a HTML file, wget downloads the file regardless of whether or not it matches the ...
Mike B's user avatar
  • 1