diff options
author | Florian Klink <flokli@flokli.de> | 2023-02-18T19·44+0100 |
---|---|---|
committer | flokli <flokli@flokli.de> | 2023-03-10T10·58+0000 |
commit | d8ab140d2505aa1669bc9378012d736dfa19cac4 (patch) | |
tree | 04b4614d499b5e005abdcc9ab0470932e114308b /fun | |
parent | a40d2dcdcd453e44d53d44b4c1471f3b503c7cd6 (diff) |
feat(tvix/store): do not buffer blob data r/5926
Use the FastCDC::cut function to ask fastcd for cutting points as we receive the data. Make sure to keep the last chunk in the temporary buffer, as we might not actually cut at the end. Also, use rayon to calculate the blake3 hash if the input data is > 128KiB. Change-Id: I6195f3b74eac5516965cb12d8d026aa720c8b891 Reviewed-on: https://cl.tvl.fyi/c/depot/+/8135 Reviewed-by: raitobezarius <tvl@lahfa.xyz> Tested-by: BuildkiteCI
Diffstat (limited to 'fun')
0 files changed, 0 insertions, 0 deletions