![]() ![]() In other words, it skips over the primary domain name. wget -nH removes the “hostname” directories.wget -X /absolute/path/to/directory will exclude a specific directory on the remote server.There are many flags to help you set up the download process. Let’s take a look at two areas in our focus on controlling the download process and creating logs. ![]() This is great if you have specific requirements for your download. You’ll find that wget is a flexible tool, as it uses a number of other additional flags. In general, it’s a good idea to disable robots.txt to prevent abridged downloads. This ignores restrictions in the robots.txt file. From there it will perform a recursive download of the entire specified URL path.Īlso, note the -e robots=off command. This will cause wget to follow any links found on the documents within the specified directory. ![]() Wget -e robots=off -r -np https: ///History / 19921103-hypertext /hypertext / ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |