File: day_229__S3_multipart.mdwn

package info (click to toggle)
git-annex 6.20170101-1%2Bdeb9u2
  • links: PTS
  • area: main
  • in suites: stretch
  • size: 50,088 kB
  • sloc: haskell: 53,116; sh: 1,582; ansic: 341; makefile: 292; perl: 144
file content (11 lines) | stat: -rw-r--r-- 638 bytes parent folder | download | duplicates (10) 
1
2
3
4
5
6
7
8
9
10
11
 
Some progress on the [[bugs/S3_upload_not_using_multipart]] bug. The aws
library now includes the multipart API. However, when I dug into it, it
looks like the API needs some changes to get the ETAG of each uploaded
part. Once that's fixed, git-annex should be able to support S3 multipart
uploads, although I think that git-annex's own chunking is better in most
situations -- it supports resuming uploads and downloads better. The main
use case for S3 multipart seems to be using git-annex to publish large
files.

Also, managed to get the backlog down from 100 to just 65 messages,
including catching up on quite old parts of backlog.