scraping/skallwar.suckit
1
0
Fork 0
mirror of https://github.com/Skallwar/suckit.git synced 2026-09-10 07:16:19 -04:00
Code Issues Actions Packages Projects Releases Wiki Activity
315 commits 5 branches 4 tags 1.2 MiB
Commit graph

62 commits

Author SHA1 Message Date
dependabot[bot] f513cc541d build(deps): bump mio from 0.8.10 to 0.8.11 
Bumps [mio](https://github.com/tokio-rs/mio) from 0.8.10 to 0.8.11.
- [Release notes](https://github.com/tokio-rs/mio/releases)
- [Changelog](https://github.com/tokio-rs/mio/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tokio-rs/mio/compare/v0.8.10...v0.8.11)

---
updated-dependencies:
- dependency-name: mio
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-03-05 09:38:09 +01:00
Esteban Blanc 4ca5f0c104 misc: Update Cargo.lock 
Signed-off-by: Esteban Blanc <estblcsk@gmail.com>
 2024-01-24 16:48:59 +01:00
dependabot[bot] 7462ab1ff7 build(deps): bump h2 from 0.3.21 to 0.3.24 
Bumps [h2](https://github.com/hyperium/h2) from 0.3.21 to 0.3.24.
- [Release notes](https://github.com/hyperium/h2/releases)
- [Changelog](https://github.com/hyperium/h2/blob/v0.3.24/CHANGELOG.md)
- [Commits](https://github.com/hyperium/h2/compare/v0.3.21...v0.3.24)

---
updated-dependencies:
- dependency-name: h2
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-01-22 10:57:03 +01:00
dependabot[bot] 4bcf2705a9
build(deps): bump rustix from 0.38.14 to 0.38.21 (#232) 2023-12-06 10:22:12 +00:00
dependabot[bot] 39b751d245 build(deps): bump openssl from 0.10.57 to 0.10.60 
Bumps [openssl](https://github.com/sfackler/rust-openssl) from 0.10.57 to 0.10.60.
- [Release notes](https://github.com/sfackler/rust-openssl/releases)
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.57...openssl-v0.10.60)

---
updated-dependencies:
- dependency-name: openssl
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-29 11:22:15 +01:00
Esteban Blanc c488442982 ci: Fix libssl install for cross-compile 
Signed-off-by: Esteban Blanc <estblcsk@gmail.com>
 2023-10-11 10:29:22 +02:00
dependabot[bot] 103d4a7505 build(deps): bump openssl from 0.10.50 to 0.10.55 
Bumps [openssl](https://github.com/sfackler/rust-openssl) from 0.10.50 to 0.10.55.
- [Release notes](https://github.com/sfackler/rust-openssl/releases)
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.50...openssl-v0.10.55)

---
updated-dependencies:
- dependency-name: openssl
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-06-22 10:42:15 +02:00
Esteban Blanc 7f6c4c34a5 tests: Auto cleanup of download folders + multiple servers 
Signed-off-by: Esteban Blanc <estblcsk@gmail.com>
 2023-05-02 10:18:59 +02:00
Esteban Blanc 208c747165 misc: Update dependencies and bump MSRV 
Signed-off-by: Esteban Blanc <estblcsk@gmail.com>
 2023-04-13 23:57:07 +02:00
dependabot[bot] 05a76ba263 build(deps): bump openssl from 0.10.45 to 0.10.48 
Bumps [openssl](https://github.com/sfackler/rust-openssl) from 0.10.45 to 0.10.48.
- [Release notes](https://github.com/sfackler/rust-openssl/releases)
- [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-v0.10.45...openssl-v0.10.48)

---
updated-dependencies:
- dependency-name: openssl
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-26 14:24:56 +02:00
dependabot[bot] bcfbacf388 build(deps): bump tokio from 1.24.1 to 1.25.0 
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.24.1 to 1.25.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.24.1...tokio-1.25.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-02-12 14:14:30 +01:00
Esteban Blanc 28c1e5f3a4 misc: update dependencies 2023-01-18 16:35:49 +01:00
dependabot[bot] 0c8164c145 build(deps): bump tokio from 1.21.2 to 1.24.1 
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.21.2 to 1.24.1.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.21.2...tokio-1.24.1)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-01-07 20:06:13 +01:00
Esteban Skallwar Blanc 62f17a236e misc: Update dependencies 2022-10-03 16:15:42 +02:00
Esteban Blanc 20c4aa1346 misc: Update dependencies 2022-08-01 01:51:43 +02:00
Esteban Blanc 1f5e53f5eb misc: Revert to openssl 
We switched some time ago to rustls in order to cross compile more
easilly but it depends on `ring` which in full assembly and does not the
future: RISC-V

This revert to openssl while making sure the CI still cross-compile
correctly to aarch64
 2022-05-12 21:56:42 +02:00
Esteban Blanc c151757af6 ci: Build for aarch64 2022-05-11 10:47:57 +02:00
Orhun Parmaksız 5e58e50a8e chore: Update Cargo.lock 2022-04-30 18:20:00 +02:00
Esteban Blanc fb124a5afb misc: Prepare for release 
Bump crate version
Update README (MSRV and usage)
 2022-04-28 13:27:05 +02:00
Esteban Blanc c57fa1081c misc: Update dependencies in Cargo.lock 2022-04-25 17:27:08 +02:00
dependabot[bot] 79f9614952
robo(deps): bump reqwest from 0.11.9 to 0.11.10 (#179) 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.9 to 0.11.10.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.9...v0.11.10)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-03-15 08:48:24 +01:00
dependabot[bot] c4cd36b98f
robo(deps): bump regex from 1.5.4 to 1.5.5 (#174) 
Bumps [regex](https://github.com/rust-lang/regex) from 1.5.4 to 1.5.5.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.5.4...1.5.5)

---
updated-dependencies:
- dependency-name: regex
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-03-09 09:08:50 +01:00
dependabot[bot] 422b810a78
robo(deps): bump rand from 0.8.4 to 0.8.5 (#169) 
Bumps [rand](https://github.com/rust-random/rand) from 0.8.4 to 0.8.5.
- [Release notes](https://github.com/rust-random/rand/releases)
- [Changelog](https://github.com/rust-random/rand/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-random/rand/compare/0.8.4...0.8.5)

---
updated-dependencies:
- dependency-name: rand
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-28 09:32:35 +01:00
dependabot[bot] f6072a9bee
robo(deps): bump tiny_http from 0.10.0 to 0.11.0 (#171) 
Bumps [tiny_http](https://github.com/tiny-http/tiny-http) from 0.10.0 to 0.11.0.
- [Release notes](https://github.com/tiny-http/tiny-http/releases)
- [Changelog](https://github.com/tiny-http/tiny-http/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tiny-http/tiny-http/compare/v0.10.0...0.11.0)

---
updated-dependencies:
- dependency-name: tiny_http
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-02-28 09:08:37 +01:00
dependabot[bot] 931f1e5131 robo(deps): bump structopt from 0.3.25 to 0.3.26 
Bumps [structopt](https://github.com/TeXitoi/structopt) from 0.3.25 to 0.3.26.
- [Release notes](https://github.com/TeXitoi/structopt/releases)
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md)
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.25...v0.3.26)

---
updated-dependencies:
- dependency-name: structopt
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-01-19 11:54:31 +01:00
dependabot[bot] a999137d31
robo(deps): bump tiny_http from 0.9.0 to 0.10.0 (#165) 
Bumps [tiny_http](https://github.com/tiny-http/tiny-http) from 0.9.0 to 0.10.0.
- [Release notes](https://github.com/tiny-http/tiny-http/releases)
- [Changelog](https://github.com/tiny-http/tiny-http/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tiny-http/tiny-http/compare/0.9.0...v0.10.0)

---
updated-dependencies:
- dependency-name: tiny_http
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-01-13 13:08:04 +01:00
dependabot[bot] 52d372372e
robo(deps): bump encoding_rs from 0.8.29 to 0.8.30 (#160) 
Bumps [encoding_rs](https://github.com/hsivonen/encoding_rs) from 0.8.29 to 0.8.30.
- [Release notes](https://github.com/hsivonen/encoding_rs/releases)
- [Commits](https://github.com/hsivonen/encoding_rs/compare/v0.8.29...v0.8.30)

---
updated-dependencies:
- dependency-name: encoding_rs
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-01-12 10:03:55 +01:00
dependabot[bot] 9330231522
robo(deps): bump reqwest from 0.11.8 to 0.11.9 (#164) 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.8 to 0.11.9.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.8...v0.11.9)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-01-11 16:02:17 +01:00
dependabot[bot] f78632c7ee
robo(deps): bump reqwest from 0.11.6 to 0.11.8 (#163) 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.6 to 0.11.8.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.6...v0.11.8)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-12-21 11:24:30 +01:00
Esteban Blanc 2f684793be misc: Enable lto 2021-11-18 12:32:07 +01:00
Esteban Blanc 7f6eb7ca37 misc: Update dependencies 2021-10-19 12:06:09 +02:00
dependabot[bot] 1f3a6cbcf7
robo(deps): bump tiny_http from 0.8.2 to 0.9.0 (#154) 
Bumps [tiny_http](https://github.com/tiny-http/tiny-http) from 0.8.2 to 0.9.0.
- [Release notes](https://github.com/tiny-http/tiny-http/releases)
- [Changelog](https://github.com/tiny-http/tiny-http/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tiny-http/tiny-http/compare/0.8.2...0.9.0)

---
updated-dependencies:
- dependency-name: tiny_http
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-10-15 12:43:16 +02:00
dependabot[bot] 399351261c robo(deps): bump reqwest from 0.11.4 to 0.11.5 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.4 to 0.11.5.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.4...v0.11.5)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-10-08 10:17:43 +02:00
dependabot[bot] 1386a4b66b robo(deps): bump pathdiff from 0.2.0 to 0.2.1 
Bumps [pathdiff](https://github.com/Manishearth/pathdiff) from 0.2.0 to 0.2.1.
- [Release notes](https://github.com/Manishearth/pathdiff/releases)
- [Commits](https://github.com/Manishearth/pathdiff/commits)

---
updated-dependencies:
- dependency-name: pathdiff
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-10-04 21:39:24 +02:00
marchellodev ef79cc2318 Add external site downloading support 
Introduces --edepth flag for external domain depth
Transforms urls that start with `//` into full https links for more accurate detection of external links
Fixes panic when url starts with `///`
Readme: Added explanation of the `--edepth` flag
--edepth -> --ext-depth
Refactors code to avoid repetition (normalizing urls)
Improved code documentation (url normalization)
README.md upd: --ext-depth
Minor docs changes (--depth)
rustfmt coding style
Updated `--ext_depth` command docs
Small code documentation improvements

Co-authored-by: CohenArthur <cohenarthur.dev@gmail.com>
Co-authored-by: Esteban Blanc <estblcsk@gmail.com>
 2021-09-23 20:43:54 +02:00
dependabot[bot] 9cb0b81286
robo(deps): bump structopt from 0.3.22 to 0.3.23 (#148) 
Bumps [structopt](https://github.com/TeXitoi/structopt) from 0.3.22 to 0.3.23.
- [Release notes](https://github.com/TeXitoi/structopt/releases)
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md)
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.22...v0.3.23)

---
updated-dependencies:
- dependency-name: structopt
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-08-31 23:12:46 +02:00
Esteban Blanc 7c05a181e0 Bump version for v0.1.2 release (#138) 2021-07-07 19:20:24 +02:00
mr-bo-jangles 0b1a556ce1 Lets make this non-unix specific for our windows based friends (#134) 
Co-authored-by: Esteban Blanc <estblcsk@gmail.com>
 2021-07-07 19:20:24 +02:00
dependabot[bot] 2c08ae00f4
robo(deps): bump structopt from 0.3.21 to 0.3.22 (#131) 
Bumps [structopt](https://github.com/TeXitoi/structopt) from 0.3.21 to 0.3.22.
- [Release notes](https://github.com/TeXitoi/structopt/releases)
- [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md)
- [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.21...v0.3.22)

---
updated-dependencies:
- dependency-name: structopt
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-07-05 09:33:37 +02:00
dependabot[bot] d388b3c3f2
robo(deps): bump crossbeam from 0.8.0 to 0.8.1 (#126) 
Bumps [crossbeam](https://github.com/crossbeam-rs/crossbeam) from 0.8.0 to 0.8.1.
- [Release notes](https://github.com/crossbeam-rs/crossbeam/releases)
- [Changelog](https://github.com/crossbeam-rs/crossbeam/blob/master/CHANGELOG.md)
- [Commits](https://github.com/crossbeam-rs/crossbeam/compare/crossbeam-0.8.0...crossbeam-0.8.1)

---
updated-dependencies:
- dependency-name: crossbeam
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-07-02 11:06:08 +02:00
dependabot[bot] ef8518e877
robo(deps): bump regex from 1.4.6 to 1.5.4 (#128) 
Bumps [regex](https://github.com/rust-lang/regex) from 1.4.6 to 1.5.4.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.4.6...1.5.4)

---
updated-dependencies:
- dependency-name: regex
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-07-02 10:53:17 +02:00
dependabot[bot] ed7a22876a
robo(deps): bump url from 2.2.0 to 2.2.2 (#127) 
Bumps [url](https://github.com/servo/rust-url) from 2.2.0 to 2.2.2.
- [Release notes](https://github.com/servo/rust-url/releases)
- [Commits](https://github.com/servo/rust-url/compare/v2.2.0...v2.2.2)

---
updated-dependencies:
- dependency-name: url
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-07-02 10:29:53 +02:00
dependabot[bot] f0c5448d1d
robo(deps): bump reqwest from 0.11.0 to 0.11.4 (#125) 
Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.0 to 0.11.4.
- [Release notes](https://github.com/seanmonstar/reqwest/releases)
- [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md)
- [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.0...v0.11.4)

---
updated-dependencies:
- dependency-name: reqwest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-07-02 10:19:53 +02:00
pinkforest(she/her) 1e034011a7
Updated dependencies and dependabot (#123) 
* Create dependabot.yml

* robo(deps): bump rand from 0.8.1 to 0.8.4

Bumps [rand](https://github.com/rust-random/rand) from 0.8.1 to 0.8.4.
- [Release notes](https://github.com/rust-random/rand/releases)
- [Changelog](https://github.com/rust-random/rand/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-random/rand/compare/0.8.1...0.8.4)

---
updated-dependencies:
- dependency-name: rand
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* robo(deps): bump subprocess from 0.2.6 to 0.2.7

Bumps [subprocess](https://github.com/hniksic/rust-subprocess) from 0.2.6 to 0.2.7.
- [Release notes](https://github.com/hniksic/rust-subprocess/releases)
- [Commits](https://github.com/hniksic/rust-subprocess/compare/release/0.2.6...release/0.2.7)

---
updated-dependencies:
- dependency-name: subprocess
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* robo(deps): bump encoding_rs from 0.8.26 to 0.8.28

Bumps [encoding_rs](https://github.com/hsivonen/encoding_rs) from 0.8.26 to 0.8.28.
- [Release notes](https://github.com/hsivonen/encoding_rs/releases)
- [Commits](https://github.com/hsivonen/encoding_rs/compare/v0.8.26...v0.8.28)

---
updated-dependencies:
- dependency-name: encoding_rs
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* robo(deps): bump tiny_http from 0.7.0 to 0.8.2

Bumps [tiny_http](https://github.com/tiny-http/tiny-http) from 0.7.0 to 0.8.2.
- [Release notes](https://github.com/tiny-http/tiny-http/releases)
- [Changelog](https://github.com/tiny-http/tiny-http/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tiny-http/tiny-http/compare/0.7.0...0.8.2)

---
updated-dependencies:
- dependency-name: tiny_http
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* robo(deps): bump regex from 1.4.3 to 1.4.6

Bumps [regex](https://github.com/rust-lang/regex) from 1.4.3 to 1.4.6.
- [Release notes](https://github.com/rust-lang/regex/releases)
- [Changelog](https://github.com/rust-lang/regex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/regex/compare/1.4.3...1.4.6)

---
updated-dependencies:
- dependency-name: regex
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-07-02 09:19:30 +02:00
Esteban Blanc 1bdb086651
Patches for #110 (#111) 
* scrapper: Log an error if an url is not in the path map

* url_helper: Fix domain/1/ vs domain/1 file or dir conflict

* url_helper: Fix to_path()
 2021-01-14 14:08:35 +01:00
Esteban Blanc 96e1f2bf52
Respect website architecture (#110) 
* scraper: Stop flat archive creation

* scrapper: Fix_domtree create only relative path

* tests: Fix to_path() tests

* tests: Fix tests

* scraper: Fix doc

Co-authored-by: CohenArthur <arthur.cohen@epita.fr>

* misc: Cleanup

* Update tests/fixtures/mod.rs

Co-authored-by: CohenArthur <arthur.cohen@epita.fr>

Co-authored-by: CohenArthur <arthur.cohen@epita.fr>
 2021-01-10 22:55:37 +01:00
Esteban Blanc db3c933423
Support other charset (#105) 
* scraper: Initial work for other charset support

Not working

* scraper: Get charset from html instead of http headers

Not working

* scraper: Charset working

* scraper: Fix regex ('"' after equals)

* scraper: Use lazy_static for charset regex

* misc: Refactor pr

* tests: Refactor fixtures

* tests: Add html charset support tests

* tests: Charset, split tests

* downloader: Get charset from http headers

* misc: Clarify iterator first

* Apply suggestions from CohenArthur

Co-authored-by: CohenArthur <arthur.cohen@epita.fr>
 2021-01-05 09:57:12 +01:00
Esteban Blanc 09af371589
misc: Update dependencies (#103) 2020-12-19 16:38:26 +01:00
Esteban Blanc ffec62254d
cargo: Add caret requirements (#93) 2020-08-31 16:52:40 +02:00
Rahul Sharma 397315b5f3
Add support for including excluding pages based on regex patterns (#83) 2020-05-17 14:21:03 +02:00