Create mirror site using wget

From Wiki
Jump to: navigation, search

wget can be used to recursively download an entire web site. For example:

wget --mirror -np --no-host-directories -A rpm,srpm http://downloads.whamcloud.com/public/lustre/latest-maintenance-release/

This will download the entire rpm mirror at the specified URL.

To grab mp3s:

 wget --mirror -np --no-host-directories -A mp3 http://www.example.com/music/