scraping/skallwar.suckit
1
0
Fork 0
mirror of https://github.com/Skallwar/suckit.git synced 2026-09-10 07:16:19 -04:00
Code Issues Actions Packages Projects Releases Wiki Activity
Tool for downloading websites.
124 commits 5 branches 4 tags 1.2 MiB
Rust 87.1%
Python 11%
Nix 1%
Shell 0.9%
Go to file
Esteban Blanc 182e77f99c
Merge pull request #37 from Skallwar/multithreaded-scraper 
Multithreaded scraper
2020-04-18 14:36:39 +02:00
.github/workflows ci: Add unit tests CI 2020-04-09 11:40:30 +02:00
src scraper: Add depth test 2020-04-18 12:56:52 +02:00
tests benchmark: Get best result instead of previous result 2020-04-16 18:25:08 +02:00
.gitignore gitignore: Ignore tags folder 2020-04-09 11:36:20 +02:00
Cargo.lock scraper: Remove lazy_static 2020-04-18 12:53:34 +02:00
Cargo.toml scraper: Remove lazy_static 2020-04-18 12:53:34 +02:00
LICENSE Initial commit 2019-10-29 18:21:52 +01:00
README.md scraper: Tick multithreading box 2020-04-18 12:59:08 +02:00

README.md

SuckIT

SuckIT allows you to recursively visit and download a website's content to your disk.

Features

  • Vacuum the entirety of a website recursively
  • Use multithreading
  • Write the website's content to your disk
  • Offline navigation