diff options
| author | Connor Brewster <cbrewster@hey.com> | 2024-04-20T21·41-0500 |
|---|---|---|
| committer | clbot <clbot@tvl.fyi> | 2024-04-23T17·02+0000 |
| commit | 79698c470cf9e043204741b727ce34041fcb1e32 (patch) | |
| tree | c686f8e716e214b5f8f8f571825fe0c59efc10a5 /tvix/castore/src/directoryservice/closure_validator.rs | |
| parent | fa69becf4d723c1549d8252eeabeb256423dbc19 (diff) | |
feat(tvix/castore): upload blobs concurrently when ingesting archives r/8001
Ingesting tarballs with a lot of small files is very slow because of the round trip time to the `BlobService`. To mitigate this, small blobs can be buffered into memory and uploaded concurrently in the background. Change-Id: I3376d11bb941ae35377a089b96849294c9c139e6 Reviewed-on: https://cl.tvl.fyi/c/depot/+/11497 Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI Autosubmit: Connor Brewster <cbrewster@hey.com>
Diffstat (limited to 'tvix/castore/src/directoryservice/closure_validator.rs')
0 files changed, 0 insertions, 0 deletions