41 Commits

Author SHA1 Message Date
Harry Chen
27e4307375
Implement rsync_override_only in mirrorConfig
Signed-off-by: Harry Chen <i@harrychen.xyz>
2025-02-27 16:45:43 +08:00
Miao Wang
2949b9c58c cgroupv2: change newCgroupHook interface 2021-07-23 15:29:28 +08:00
♥️
60beeb6ccd
add useIPv4 option to two stage rsync (#150) 2021-01-07 14:35:21 +08:00
zyx
c00eb12a75 Two new options for rsync provider
- rsync_no_timeout=true/false # disable --timeout option
- rsync_timeout=n # set --timeout=n
related to issue #121
2020-06-03 13:26:49 +08:00
zyx
e47ba2097e add a timeout field to providers 2020-05-25 18:24:05 +08:00
z4yx
38b0156fae [bug fix] provider is not terminated if premature stop command received 2020-05-09 18:42:54 +08:00
Miao Wang
7a9895350b Support nested mirror config 2020-03-29 00:24:58 +08:00
zyx
b1f2679fbf [cmd provider] add support of match size in logs 2020-03-20 10:30:44 +08:00
z4yx
365f49e6d3 add support of env config for rsync provider 2020-03-16 20:59:08 +08:00
z4yx
02468e21c0 add an option "rsync_override" 2020-03-13 15:12:52 +08:00
z4yx
908f098c72 [mirror config] job fails on pattern match in log 2020-03-09 21:48:06 +08:00
Yuxiang Zhang
22cfdfc9c2
[mirror config] extra rsync options (#107)
* support "rsync_options" array in config

* add test for new options

* fix tests
2020-03-09 20:48:09 +08:00
Jeeken Wang
501f77ee41 Merge branch 'master' into feature/btrfs-snapshot 2019-08-15 01:26:28 +08:00
z4yx
94cf0b4bdb fix possible null dereferencing, reported by #96 2019-08-13 23:07:01 +08:00
WANG Ziqin
6b56c4254c feat(btrfs_snapshot_hook): reimplemented Btrfs snapshots
TODO: test coverage
2019-08-02 13:31:33 +08:00
WANG Ziqin
30259da0f0 fix nil pointer dereference: check err first 2019-08-02 02:15:22 +08:00
zyx
1aa4ae9cc1 Merge remote-tracking branch 'kinosang/master' into wip-test-pr 2019-04-13 02:07:41 +08:00
zyx
d0deeb19a9 extract mirror size from rsync provider automatically 2019-04-13 01:27:35 +08:00
bigeagle
a475b044c6 feat(worker): add 'use_ipv4' option for rsync provider 2017-09-08 00:15:48 +08:00
7IN0SAN9
563860d424
fix #63 2017-03-27 13:09:56 +08:00
bigeagle
7601e5793f
fix(worker): improved cgroup creation 2016-12-10 04:14:39 +08:00
bigeagle
ebd462be36
feat(worker): Implemented docker executor, close #55
if docker is enabled in configure file and `docker_image` is set on mirror config, the command would

be executed via `docker run ...`
2016-12-10 02:44:45 +08:00
bigeagle
86153c59e3
feat(worker): ZFS support: isolate mirrors in zfs datasets 2016-12-05 00:44:55 +08:00
bigeagle
2b83ea4b45 feat(worker): added global exec_on_success and exec_on_failure options
if `exec_on_success` is set on mirror-level config, it overrides the global option; if on mirror

level, extra hook cmd is needed, use `exec_on_success_extra` option
2016-10-21 01:20:31 +08:00
bigeagle
ebeee6bc34
feat(worker): added username option for rsync providers 2016-06-14 21:37:03 +08:00
bigeagle
ccc31d9289
refactor(worker): added Type() method to provider 2016-05-08 16:26:58 +08:00
bigeagle
51fa12900d
feature(worker): ability to hot reload mirror job configrations, close #18 2016-05-02 17:45:21 +08:00
bigeagle
56459f2ce0
feature(worker): implemented mirror role (master/slave) option 2016-04-30 16:44:39 +08:00
bigeagle
f8fd1ae460
style: better logging 2016-04-30 16:43:47 +08:00
bigeagle
924fda6dd8
feature(worker): use cgroup track job process, so that they can be all-killed 2016-04-30 16:43:30 +08:00
bigeagle
292a24ba20
fix(worker): fixed job status and control logic 2016-04-30 16:42:51 +08:00
bigeagle
ce3471e30d
feature(worker): implemented Worker object, worker side code is almost done 2016-04-30 16:41:39 +08:00
bigeagle
6062aa4b9d
refactor(worker): rename provider.setLogFile to provider.prepareLogFile 2016-04-30 16:40:45 +08:00
bigeagle
9afd47ddcb
feature(worker): LogLimiter hook 2016-04-30 16:40:40 +08:00
bigeagle
13161d77cf
feature(worker): two-stage-rsync provider 2016-04-30 16:40:12 +08:00
bigeagle
9339fba074
refactor(worker): use Run instead of Start and Wait 2016-04-30 16:40:05 +08:00
bigeagle
a6e8e9e2d9
feature(worker): implemented rsync provider 2016-04-30 16:39:59 +08:00
bigeagle
681388ffdd
feature(worker): toplevel mirror job logic 2016-04-30 16:39:08 +08:00
bigeagle
0e808a449a
refactor(worker): change provider's Run method to Start, and change logfile handling 2016-04-30 16:38:57 +08:00
bigeagle
44af0d5e62
feature(worker): framework of mirror provider 2016-04-30 16:38:17 +08:00
bigeagle
f95a0f9a6f
feature(worker): context object to store runtime configurations 2016-04-30 16:38:10 +08:00