Sunday, September 11, 2011

15 wget command examples


Wget is to download  download of files from the Web.
It supports HTTP, HTTPS, and FTP protocols, as well as
retrieval through HTTP proxies.
Syntax
wget [option] … [URL] …
Multiple options can be, for example
wget-rpk http://www.example.com
Usage Examples
Download file
wget http://www.example.com/fichier.html
Download a file whose URL contains a “&” (note quotes)
wget “http://www.example.com/min.php?page=home&user=ma”
Download, in addition to the specified file, all files required for optimal viewing
wget-p http://www.example.com/index.html
Draw an entire site (recursive download)
wget-r http://www.example.com/
Resume a download
wget-c http://www.example.com/xyz.html
Specify the name of the file once downloaded
wget – output-document = index.html http://www.example.com/index.php?page=home
Download files only an extension (here,. Jpg)
wget-A.jpg http://www.example.com/
Limit download speed
wget – limit-rate = 30k http://www.example.com/
Using a file containing addresses for download
wget-i liste_de_zyx.txt
Mp3 download all addresses contained in this list
wget-r-l1-H-t1-nd-N-np-a.mp3 erobots = off-imp3_sites.txt
Links automatically convert to a local consultation pages
wget-k http://www.example.com/
Download via ftp (With authentication)
wget-r l4 ftp://username:password @ example.com /
Create a backup of your del.icio.us bookmarks
wget http://del.icio.us/username/
Use wget to display the page source on the terminal
wget-qO – http://www.example.com/blog
For instance, if your .wgetrc
sets “exclude_directories” to /cgi-bin, the following example will
first reset it, and then set it to exclude /~nobody and /~somebody.
You can also clear the lists in .wgetrc.
wget -X ” -X /~nobody,/~somebody