mirror of
https://github.com/Skallwar/suckit.git
synced 2026-09-10 07:16:19 -04:00
1.2 KiB
1.2 KiB
SuckIT
SuckIT allows you to recursively visit and download a website's content to
your disk.
Features
- Vacuums the entirety of a website recursively
- Uses multithreading
- Writes the website's content to your disk
- Enables offline navigation
- Saves application state on CTRL-C for later pickup
- Offers random delays to avoid IP banning
Options
| Option | Behavior |
|---|---|
-h, --help |
Displays help information |
-v, --verbose |
Activate Verbose output |
-d, --depth |
Specify the level of depth to go to when visiting the website |
-j, --jobs |
Number of threads to use |
-o, --output |
Output directory where the downloaded files are written |
-t, --tries |
Number of times to retry when the downloading of a page fails |
Example
A common use case could be the following:
suckit http://books.toscrape.com -j 8 -o /path/to/downloaded/pages/
Want to contribute ? Feel free to open an issue or submit a PR !