File: day_594__finally_background_checksum_verification.mdwn

package info (click to toggle)
git-annex 8.20210223-2
  • links: PTS, VCS
  • area: main
  • in suites: bullseye
  • size: 68,764 kB
  • sloc: haskell: 70,359; javascript: 9,103; sh: 1,304; makefile: 212; perl: 136; ansic: 44
file content (14 lines) | stat: -rw-r--r-- 704 bytes parent folder | download | duplicates (5)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
Finally got checksum verification running in a separate job pool from
downloads, to better keep bandwidth saturated.

I had to resort to what felt like a bit of a hack, but I can't see a better
way to do it. Also, I got stuck for far too long on a STM deadlock bug.

Interestingly, this means that -J1 now has a purpose, it's not the same as
no -J option. Instead, it lets one download and also one concurrent
checksum of the previous download run at the same time.

It would be nice if -J1 could be the default.. One problem with that is
that it needs a unicode locale to work due to a limitation of
concurrent-output. Changing the concurrency method based on the locale does
not seem like a good idea.