Commit Graph

  • a5ffd11fdb Add extra verification with package JSON meta for filter updates master taoky 2025-07-07 02:01:07 +08:00
  • f653de5a98 Reformat with ruff taoky 2025-07-07 01:39:30 +08:00
  • 1c8b0199b4 Auto PyPI fallback in SyncPlainHTTP taoky 2025-07-07 01:39:07 +08:00
  • 94cc16db5e Note breaking changes in README taoky 2025-06-29 02:05:42 +08:00
  • 40da452f3d Adjust exclude in example config taoky 2025-06-29 01:59:05 +08:00
  • 8ad920ee82 Use re.search instead of re.match for pattern matching taoky 2025-06-29 01:55:32 +08:00
  • 611d18c5d7 Add missing excluded_wheel_filename in example toml taoky 2025-06-19 21:13:18 +08:00
  • 5a4f28a3d3 Add --excluded-wheel-filename taoky 2025-06-17 23:32:06 +08:00
  • 5942907954 Bump requests from 2.32.3 to 2.32.4 dependabot[bot] 2025-06-17 04:05:53 +00:00
  • 85e691d50f
    Bump requests from 2.32.3 to 2.32.4 dependabot[bot] 2025-06-17 04:05:53 +00:00
  • bbcab99b4d Fix timeout setting in CustomXMLRPCTransport taoky 2025-01-13 21:12:46 +08:00
  • 5dd445507d Clarify license taoky 2024-11-11 17:22:33 +08:00
  • 1856a97e2d Add clear-invalid-packages command taoky 2024-10-30 21:15:40 +08:00
  • 5f057c5e47 Add SHADOWMIRE_IGNORE_THRESHOLD option taoky 2024-10-30 20:30:39 +08:00
  • b73dca7688 Add clear-invalid-packages command nonexist-retries-1 taoky 2024-10-30 21:15:40 +08:00
  • 354bfaf28e Add SHADOWMIRE_IGNORE_THRESHOLD option taoky 2024-10-30 20:30:39 +08:00
  • 1ca3e23bcf Add timeout for requests.Session and XMLRPC taoky 2024-09-27 18:56:29 +08:00
  • 4664c23ad5 Use logger.warning() to replace deprecated warn() taoky 2024-09-27 18:31:54 +08:00
  • 3a1b20541c Optimize utils.create_package_stubs taoky 2024-09-04 17:52:59 +08:00
  • 47529107ae Use unquote to handle encoded path taoky 2024-09-04 17:05:58 +08:00
  • 99bd4d932e Add multithreading to genlocal taoky 2024-09-04 14:08:18 +08:00
  • 20c1462ec7 Set default IOWORKERS to 2 taoky 2024-09-04 01:08:50 +08:00
  • 7d78d998ba Add utils.create_package_stubs for debugging taoky 2024-09-04 00:26:05 +08:00
  • 40c9edba50 Add generate pathcache as Step 3 taoky 2024-09-04 00:18:08 +08:00
  • 7c963b00b1 Check package size in do_update() taoky 2024-09-03 23:09:36 +08:00
  • a5dbd61e95 Replace glob by fast_iterdir in verification step 4 taoky 2024-09-03 22:47:43 +08:00
  • 6e4aa61119 Add fast_readall to save some syscalls taoky 2024-09-03 17:03:55 +08:00
  • bfdecd4d8f Mention IOWORKERS in README.md taoky 2024-08-27 21:41:03 +08:00
  • cd40fc1f40 DRY in futures exception handling taoky 2024-08-27 21:39:35 +08:00
  • 99fabce7b8 Parallelize verification step 4 taoky 2024-08-27 20:33:36 +08:00
  • 9e57eb6f46 Optimize get_existing_hrefs for fast path (json file exists) taoky 2024-08-27 19:20:20 +08:00
  • 799a477336 Parallelize verification step 3 with threads taoky 2024-08-27 19:06:05 +08:00
  • d64ea61be7 Only do one stat() for packages when sync-packages is on in verification step 3 taoky 2024-08-27 18:46:19 +08:00
  • f4927fdb0d Save a bit syscalls in check_and_update() taoky 2024-08-27 18:26:02 +08:00
  • bc6159807d iterdir() optimization taoky 2024-08-27 16:36:37 +08:00
  • aa6ece7e8b Add TUNA to acknowledgements taoky 2024-08-25 00:10:47 +08:00
  • 17d48f2456 Add type parameter for package_names list taoky 2024-08-24 17:41:31 +08:00
  • 972c94d35b Add MAX_DELETION "safety net" taoky 2024-08-21 17:31:14 +08:00
  • 8e25bb46ac Add MAX_DELETION "safety net" max-deletion-1 taoky 2024-08-21 17:31:14 +08:00
  • 0a6a958e49 Fix getting last serial in SyncPlainHTTP taoky 2024-08-11 04:54:23 +08:00
  • d565ac388b Fix urljoin usage in SyncPlainHTTP taoky 2024-08-11 04:46:47 +08:00
  • b9c6ac5c62 Add verification for v1_html and symlink taoky 2024-08-10 19:39:00 +08:00
  • b5fca47101 Make simple/<package>/index.html symlink to index.v1_html taoky 2024-08-10 19:32:34 +08:00
  • a913965c22 Fix logging in genlocal taoky 2024-08-08 18:16:13 +08:00
  • 4e20615ed6 Fix logging not showing taoky 2024-08-08 16:58:06 +08:00
  • 3da636ad00 doc: fix typo in README Shengqi Chen 2024-08-08 16:38:51 +08:00
  • a2b2a941e2 doc: update README, mainly on verify Shengqi Chen 2024-08-08 16:32:03 +08:00
  • 4d509dfb5e chore: add more logging output Shengqi Chen 2024-08-08 15:47:52 +08:00
  • d09c3a8ed1 chore: adjust default logging format Shengqi Chen 2024-08-08 15:26:59 +08:00
  • b6071ec2e9 chore: seprate third-party imports Shengqi Chen 2024-08-08 15:23:21 +08:00
  • bc9ccb5f18
    doc: fix typo in README Shengqi Chen 2024-08-08 16:38:51 +08:00
  • 8cb6944f13
    doc: update README, mainly on verify Shengqi Chen 2024-08-08 16:32:03 +08:00
  • 0a88005457
    chore: add more logging output Shengqi Chen 2024-08-08 15:47:52 +08:00
  • 32e611b663
    chore: adjust default logging format Shengqi Chen 2024-08-08 15:26:59 +08:00
  • ef78113c5e
    chore: seprate third-party imports Shengqi Chen 2024-08-08 15:23:21 +08:00
  • f1a2a023de Some linting fixes taoky 2024-08-08 14:52:39 +08:00
  • 4d602a3649 Add --use-pypi-index taoky 2024-08-08 14:50:22 +08:00
  • 008617cccd Set repo with argument/config (no longer use env) taoky 2024-08-08 14:33:34 +08:00
  • 8145552631 Add license info taoky 2024-08-08 14:14:32 +08:00
  • 1cfb6c8a99 More normpath() to replace resolve() taoky 2024-08-08 06:28:25 +08:00
  • c120c2c747 Fix step 3 syncing removed packages in verify, and performance improvement in check_and_update() taoky 2024-08-08 06:24:20 +08:00
  • 5637860cde Avoid unnecessary fs syscalls in verify step 4 taoky 2024-08-08 06:09:37 +08:00
  • e9781e7cd9 Add tqdm for step 4 in verify taoky 2024-08-08 01:09:42 +08:00
  • 9dbc320a1e Handle cases where size is not available from JSON taoky 2024-08-06 23:45:11 +08:00
  • dad48fc8a9 Defer package removal in verify taoky 2024-08-06 23:28:02 +08:00
  • 6102de1bf7 Save remote_excluded.json to basedir taoky 2024-08-06 23:00:08 +08:00
  • 5585de30ce Change --not-remove-not-in-local to --remove-not-in-local taoky 2024-08-06 22:09:36 +08:00
  • baef090078 Print package number to update/remove in verify taoky 2024-08-06 22:06:30 +08:00
  • e5c542c718 Show remote package numbers, and also export remote to JSON file after exclusion taoky 2024-08-06 22:02:41 +08:00
  • 79a2dec5f5 Add --compare-size for verify taoky 2024-08-06 21:57:53 +08:00
  • 2bdb9355cf Add --no-remove-not-in-local for verify taoky 2024-08-06 21:08:54 +08:00
  • fcb8f8bfee Log printing and debugging taoky 2024-08-06 21:03:05 +08:00
  • aa4ae7e477 Add some type hints for mypy strict mode taoky 2024-08-06 18:39:23 +08:00
  • 6751bc93cb Add prerelease filter support in verify taoky 2024-08-06 18:23:07 +08:00
  • 33e9746a46 Implement prerelease filter in SyncPlainHTTP taoky 2024-08-06 18:17:18 +08:00
  • 231b891565 Write original meta to json/ taoky 2024-08-06 18:03:26 +08:00
  • b97754ce34 Update check_and_update() to check both json and html taoky 2024-08-06 18:00:27 +08:00
  • c8a11d3d1f Config file support and other fixes taoky 2024-08-06 14:41:51 +08:00
  • a6358aad8d Add logger.info to verify taoky 2024-08-06 13:22:08 +08:00
  • 18d6847f76 Misc fixes taoky 2024-08-06 13:11:56 +08:00
  • c613d21fa1 Fix genlocal behavior taoky 2024-08-06 12:58:10 +08:00
  • 70a99b8594 Add json/<package_name> support and bug fixes taoky 2024-08-06 03:06:21 +08:00
  • 2aa8c9ae97 Adjust verify behavior taoky 2024-08-05 22:04:33 +08:00
  • 804fba55cb Add warning about current state taoky 2024-08-05 20:31:32 +08:00
  • bede75051e Overwrite index after package sync in SyncPlainHTTP do_update taoky 2024-08-05 20:22:03 +08:00
  • 7df08fcbde Call do_remove for nonexist package metadata in do_update taoky 2024-08-05 20:19:43 +08:00
  • 6f76afcdcc Fix incorrect prerelease exclude behavior taoky 2024-08-04 18:50:54 +08:00
  • f85d291811 Update verify, and do-{update,remove} help taoky 2024-08-04 17:46:23 +08:00
  • f66213231f Add help about prerelease filtering taoky 2024-08-04 17:35:26 +08:00
  • 649d14c4fd Remove invalid local ones when planning taoky 2024-08-04 17:14:49 +08:00
  • 9008d2cbce Fix invalid package skipping taoky 2024-08-04 17:09:58 +08:00
  • 0f97cb7dbd Put serial -1 handling at LocalVersionKV taoky 2024-08-04 16:51:23 +08:00
  • d92d2079bd Mark not-found packages serial as -1 taoky 2024-08-04 16:46:03 +08:00
  • 7d4aef2f8a Add do_update/do_remove command taoky 2024-08-04 16:35:43 +08:00
  • 5dc892c0b3 Add prerelease exclusion taoky 2024-08-04 16:20:08 +08:00
  • c695419700 Use click to replace argparse taoky 2024-08-04 16:01:13 +08:00
  • 8d2460cf73 Add shebang taoky 2024-08-03 02:46:13 +08:00
  • 5e61f833e6 Add important notice about sync-packages behavior taoky 2024-08-03 02:39:43 +08:00
  • ada070d10e Add retry for requests.Session taoky 2024-08-03 02:35:42 +08:00
  • 9ecdfee147 Add some docs taoky 2024-08-02 22:36:38 +08:00