about summary refs log tree commit diff
path: root/users/Profpatsch/lorri-wait-for-eval/LorriWaitForEval.hs
diff options
context:
space:
mode:
authorConnor Brewster <cbrewster@hey.com>2024-04-20T21·41-0500
committerclbot <clbot@tvl.fyi>2024-04-23T17·02+0000
commit79698c470cf9e043204741b727ce34041fcb1e32 (patch)
treec686f8e716e214b5f8f8f571825fe0c59efc10a5 /users/Profpatsch/lorri-wait-for-eval/LorriWaitForEval.hs
parentfa69becf4d723c1549d8252eeabeb256423dbc19 (diff)
feat(tvix/castore): upload blobs concurrently when ingesting archives HEAD r/8001 canon
Ingesting tarballs with a lot of small files is very slow because of the
round trip time to the `BlobService`. To mitigate this, small blobs can
be buffered into memory and uploaded concurrently in the background.

Change-Id: I3376d11bb941ae35377a089b96849294c9c139e6
Reviewed-on: https://cl.tvl.fyi/c/depot/+/11497
Reviewed-by: flokli <flokli@flokli.de>
Tested-by: BuildkiteCI
Autosubmit: Connor Brewster <cbrewster@hey.com>
Diffstat (limited to 'users/Profpatsch/lorri-wait-for-eval/LorriWaitForEval.hs')
0 files changed, 0 insertions, 0 deletions