6 commits

Author	SHA1	Message	Date
Esteban Blanc	7f6c4c34a5	tests: Auto cleanup of download folders + multiple servers ... Signed-off-by: Esteban Blanc <estblcsk@gmail.com>	2023-05-02 10:18:59 +02:00
Esteban Blanc	c080df3c96	tests: Fix server returned content ... Signed-off-by: Esteban Blanc <estblcsk@gmail.com>	2023-05-02 10:18:59 +02:00
Esteban Blanc	96e1f2bf52	Respect website architecture (#110) ... * scraper: Stop flat archive creation * scrapper: Fix_domtree create only relative path * tests: Fix to_path() tests * tests: Fix tests * scraper: Fix doc Co-authored-by: CohenArthur <arthur.cohen@epita.fr> * misc: Cleanup * Update tests/fixtures/mod.rs Co-authored-by: CohenArthur <arthur.cohen@epita.fr> Co-authored-by: CohenArthur <arthur.cohen@epita.fr>	2021-01-10 22:55:37 +01:00
Esteban Blanc	db3c933423	Support other charset (#105) ... * scraper: Initial work for other charset support Not working * scraper: Get charset from html instead of http headers Not working * scraper: Charset working * scraper: Fix regex ('"' after equals) * scraper: Use lazy_static for charset regex * misc: Refactor pr * tests: Refactor fixtures * tests: Add html charset support tests * tests: Charset, split tests * downloader: Get charset from http headers * misc: Clarify iterator first * Apply suggestions from CohenArthur Co-authored-by: CohenArthur <arthur.cohen@epita.fr>	2021-01-05 09:57:12 +01:00
orhun	d9c17d9ec2	fix: Use CARGO_BIN_EXE instead of hardcoded path for tests (#98)	2020-10-12 13:43:10 +02:00
Patrick Sier	f3f19fd1e8	Add support for HTTP basic auth args (#96) ... * feat: add arg for HTTP basic auth * feat: chunk space-separated auth args * refactor: update auth hashmap, host handling Require host for auth HashMap, defaulting to the origin URL's host value if not provided otherwise. * refactor: auth help string, constant updates * test: add auth functional tests	2020-10-12 09:17:44 +02:00