Esteban Blanc
7f6c4c34a5
tests: Auto cleanup of download folders + multiple servers
...
Signed-off-by: Esteban Blanc <estblcsk@gmail.com>
2023-05-02 10:18:59 +02:00
Esteban Blanc
c080df3c96
tests: Fix server returned content
...
Signed-off-by: Esteban Blanc <estblcsk@gmail.com>
2023-05-02 10:18:59 +02:00
raphTec
97e3a16f49
Add visit filter tests
2022-04-24 18:38:03 +02:00
raphTec
0d75eb68b9
Empty test directories before running tests
...
Otherwise a failed test leaves the directory populated, which fails future test runs.
2022-04-24 18:38:03 +02:00
raphTec
ed56e9a078
Rename existing tests
2022-04-24 18:38:03 +02:00
Esteban Blanc
04edd27550
Add tests for external download
2021-09-23 20:43:54 +02:00
Esteban Blanc
96e1f2bf52
Respect website architecture ( #110 )
...
* scraper: Stop flat archive creation
* scrapper: Fix_domtree create only relative path
* tests: Fix to_path() tests
* tests: Fix tests
* scraper: Fix doc
Co-authored-by: CohenArthur <arthur.cohen@epita.fr>
* misc: Cleanup
* Update tests/fixtures/mod.rs
Co-authored-by: CohenArthur <arthur.cohen@epita.fr>
Co-authored-by: CohenArthur <arthur.cohen@epita.fr>
2021-01-10 22:55:37 +01:00
CohenArthur
299247a107
Use local webserver for speed testing ( #108 )
...
* tests: Add script to set up local server
* tests: Remove old results from speed.csv since test methodology changes
* tests: Change speed_regression so it downloads locally hosted webserver
* local_server_setup: Remove need of sudo since suckit understands ports
* speed_regression: Start local web server in script
Co-authored-by: Esteban Blanc <estblcsk@gmail.com>
2021-01-06 11:10:38 +01:00
Esteban Blanc
db3c933423
Support other charset ( #105 )
...
* scraper: Initial work for other charset support
Not working
* scraper: Get charset from html instead of http headers
Not working
* scraper: Charset working
* scraper: Fix regex ('"' after equals)
* scraper: Use lazy_static for charset regex
* misc: Refactor pr
* tests: Refactor fixtures
* tests: Add html charset support tests
* tests: Charset, split tests
* downloader: Get charset from http headers
* misc: Clarify iterator first
* Apply suggestions from CohenArthur
Co-authored-by: CohenArthur <arthur.cohen@epita.fr>
2021-01-05 09:57:12 +01:00
orhun
d9c17d9ec2
fix: Use CARGO_BIN_EXE instead of hardcoded path for tests ( #98 )
2020-10-12 13:43:10 +02:00
Patrick Sier
f3f19fd1e8
Add support for HTTP basic auth args ( #96 )
...
* feat: add arg for HTTP basic auth
* feat: chunk space-separated auth args
* refactor: update auth hashmap, host handling
Require host for auth HashMap, defaulting to the origin URL's host value
if not provided otherwise.
* refactor: auth help string, constant updates
* test: add auth functional tests
2020-10-12 09:17:44 +02:00
Rahul Sharma
397315b5f3
Add support for including excluding pages based on regex patterns ( #83 )
2020-05-17 14:21:03 +02:00
CohenArthur
f9f6bc6c47
speed_regression: Change from 5 retries to 10 ( #61 )
...
Co-authored-by: Esteban Blanc <estblcsk@gmail.com>
2020-05-05 17:31:02 +02:00
CohenArthur
6e93171185
Better help for CLI arguments ( #56 )
...
* args: Add 'help' section
* benchmark: Add more data
* Update src/args.rs
Co-authored-by: Esteban Blanc <estblcsk@gmail.com>
* Update src/args.rs
Co-authored-by: Esteban Blanc <estblcsk@gmail.com>
Co-authored-by: Esteban Blanc <estblcsk@gmail.com>
2020-05-01 13:48:39 +02:00
cohenarthur
70f0acfca7
args: Change quiet to verbose since default behavior is quiet
2020-04-18 16:27:21 +02:00
cohenarthur
0f12dd5a6e
benchmark: Get best result instead of previous result
2020-04-16 18:25:08 +02:00
cohenarthur
203b6780ba
typo: Remove fake results for testing
2020-04-16 16:58:22 +02:00
cohenarthur
e66a217575
speed_regression: Add better output + mean computing
2020-04-16 16:46:51 +02:00
cohenarthur
c1495bd802
scraper: Need to add 10 tries and mean to calculate time
2020-04-16 16:11:29 +02:00
cohenarthur
b507ee5cdc
speed_bench: Add work around benchmarks
2020-04-16 15:56:30 +02:00
Esteban Blanc
dd9ee74a1d
speed-test: Add print of improvement
2020-04-16 13:15:14 +02:00
cohenarthur
d0890a920a
speed_regression: WIP: Add base for speed benchmark
2020-04-16 13:25:52 +02:00
cohenarthur
18dad5d8d0
bench: Add URL arg and better default values
2020-04-14 12:41:00 +02:00
cohenarthur
942755d283
bench: Add option to give suckit path
2020-04-14 12:11:41 +02:00
cohenarthur
ca2bf6e44e
bench: Add argument parsing
2020-04-14 12:02:58 +02:00
cohenarthur
a88a402dc4
bench: Clean directory afterwards
2020-04-14 11:50:45 +02:00
cohenarthur
f5b2a2f434
bench: Add start of framework for benching suckit
2020-04-14 11:20:33 +02:00
