about summary refs log tree commit diff
AgeCommit message (Collapse)AuthorFilesLines
2024-10-03 r/8752 chore(tvix/[ca]store): Drop sled support completely in favor of redbIlan Joselevich14-812/+18
Over the past couple of months we've been using redb instead of sled as the default filesystem-based database in PS and DS. I am confident that we can get rid of sled completely now, and just keep redb. Change-Id: I11fa1e4453e280253855f8eade990b37eb6965ae Reviewed-on: https://cl.tvl.fyi/c/depot/+/12567 Reviewed-by: yuka <yuka@yuka.dev> Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI Autosubmit: Ilan Joselevich <personal@ilanjoselevich.com>
2024-10-03 r/8751 feat(tazjin/desktop): install kanshi for output managementVincent Ambo1-0/+2
Change-Id: I64b41d7ee43cfc882cf313f10888fb4447b4bc33 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12566 Autosubmit: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI Reviewed-by: tazjin <tazjin@tvl.su>
2024-10-02 r/8750 docs(tazjin/niri-reap): add a simple READMEVincent Ambo1-0/+20
Change-Id: I53c760115bda3df2f964ac359f4c9e127c9890ad Reviewed-on: https://cl.tvl.fyi/c/depot/+/12565 Autosubmit: tazjin <tazjin@tvl.su> Reviewed-by: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-10-02 r/8749 feat(tazjin/niri-reap): improve reaping of workspaces aboveVincent Ambo1-8/+25
Previously the script ignored workspaces that were further up, but in practice I don't care about their order, I just want them to be gone. To keep IDs stable, this implements a fix where the current workspace is first moved to the first position (invisible), and windows are then reaped afterwards. I've tried this in various combinations and it seems to work fine. Change-Id: Ifc3eb272af761670ec83305665ec2103eb4f269e Reviewed-on: https://cl.tvl.fyi/c/depot/+/12564 Tested-by: BuildkiteCI Reviewed-by: tazjin <tazjin@tvl.su> Autosubmit: tazjin <tazjin@tvl.su>
2024-10-01 r/8748 test(tvix/castore/refscan): add empty pattern regression testYureka1-0/+16
Change-Id: I165261170edaabfc56f6ac0a6baae388332b3f73 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12559 Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de> Autosubmit: yuka <yuka@yuka.dev>
2024-10-01 r/8747 fix(tvix/castore/refscan): don't panic on empty patternsYureka1-1/+9
Previously, the overlap calculation would underflow when the pattern is empty. Change-Id: I1f6bf49fafc4b8183a3a5e5e491a5a5bfc41ca97 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12558 Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI Autosubmit: yuka <yuka@yuka.dev>
2024-10-01 r/8746 docs(tvix/TODO): add PathInfo data types and ca reference itemsFlorian Klink1-0/+43
With https://cl.tvl.fyi/12533 in, we still need to lookup references to properly populate `BuildRequest`. It currently fails as the reference to h9lc1dpi14z7is86ffhl3ld569138595-audit-tmpdir.sh is not propagated. We should prevent Frankenbuilds from the go, so let's update our PathInfo type to accomodate for that. Change-Id: I26f9215312c258bba222efd390bc135f1a3a3d6d Reviewed-on: https://cl.tvl.fyi/c/depot/+/12560 Reviewed-by: raitobezarius <tvl@lahfa.xyz> Autosubmit: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-10-01 r/8745 feat(tvix/build/oci): wire up refscanningYureka1-20/+47
Change-Id: I07d016f831dcc596b4627f1d8f33909e632be416 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12533 Autosubmit: yuka <yuka@yuka.dev> Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de>
2024-10-01 r/8744 feat(tvix/build), add OciBuildService, the old wayFlorian Klink14-18/+1270
This is just patchset 10 of CL10855, before the color_eyre changes, rebased to the tvix_castore api. Change-Id: If4b42412ff8568058908cda971ad7d6f2d9f9b7b --- This provides a build service invoking runc. It can be used by using the `oci://$path_to_some_tempdir` builder URL for now. For now, it can be tested as such: ``` BUILD_SERVICE_ADDR=oci://$PWD/bundles target/debug/tvix let pkgs = (import <nixpkgs> {}); in builtins.readDir pkgs.perl ``` readDir is to actually trigger IO into the store path (which triggers the builds). For now it fails due to missing reference scanning (see followup CLs). Change-Id: I09b40e410114ce69966a41a0e3c33281b859e443 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12526 Autosubmit: yuka <yuka@yuka.dev> Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de>
2024-10-01 r/8743 feat(tvix/glue): wire up nix refscanningYureka2-12/+73
After this, attempting to build the nixpkgs still fails in the same way, because the references are not yet properly used by the code at `tvix/glue/src/tvix_store_io.rs`. Change-Id: I8a59ef8ef3c9a6f6aa7b05106dd9eef2e9ac0d0f Reviewed-on: https://cl.tvl.fyi/c/depot/+/12532 Reviewed-by: Brian Olsen <me@griff.name> Autosubmit: yuka <yuka@yuka.dev> Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de>
2024-10-01 r/8742 feat(tvix/build): add refscanning interfaceYureka3-42/+153
This provides a generic interface to let the builder search for needles in the output, as described in the notes at `docs/src/build/index.md`. Change-Id: Ic2c5bd563e9aa2e766c157f2b13cdb19aede12f8 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12531 Autosubmit: yuka <yuka@yuka.dev> Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de> Reviewed-by: Brian Olsen <me@griff.name>
2024-10-01 r/8741 feat(castore/fs): optional refscanner for ingestYureka5-22/+60
Change-Id: Ieca06de4c2e2680d89fe05a380079fafa5454837 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12529 Autosubmit: yuka <yuka@yuka.dev> Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de>
2024-10-01 r/8740 feat(tvix/castore/refscan): share the scanner between readersYureka1-39/+30
This changes the only actual state the ReferenceScanner has to use atomic bools, so it no longer requires a mutable borrow for .scan(). This allows passing an immutable borrow of a reference scanner to multiple threads which might be ingesting blobs in parallel, and using them in the ReferenceReader or calling .scan() there. Change-Id: Id5c30bcebb06bf15eae8c4451d70eb806cab722e Reviewed-on: https://cl.tvl.fyi/c/depot/+/12528 Autosubmit: yuka <yuka@yuka.dev> Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-10-01 r/8739 fix(tazjin/emacs): ensure niri package is loadedVincent Ambo1-0/+1
Change-Id: I8e5e30a1da2937555ac63bf024a4e3d6b2e9872a Reviewed-on: https://cl.tvl.fyi/c/depot/+/12555 Reviewed-by: tazjin <tazjin@tvl.su> Autosubmit: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-09-30 r/8738 feat(tvix/nar-bridge): treat HEAD requests explicitlyFlorian Klink2-4/+13
We don't need to access castore for HEAD requests. Change-Id: I9365d9520d5a9e52ed92897d3c4972ec5b6e11fb Reviewed-on: https://cl.tvl.fyi/c/depot/+/12547 Autosubmit: flokli <flokli@flokli.de> Reviewed-by: raitobezarius <tvl@lahfa.xyz> Tested-by: BuildkiteCI
2024-09-30 r/8737 feat(tvix/nar-bridge): implement range request for NARsFlorian Klink5-21/+352
With an implementation of AsyncRead + AsyncSeek, axum-range can answer range requests. We only use it if a range has been requested, as it uses more memory than the linear variant. Change-Id: I0072b0a09b328f3e932f14567a2caa3a49abcbf7 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12509 Autosubmit: flokli <flokli@flokli.de> Tested-by: BuildkiteCI Reviewed-by: raitobezarius <tvl@lahfa.xyz> Reviewed-by: yuka <yuka@yuka.dev>
2024-09-29 r/8736 feat(aspen/system): Add desktop entry for emacs on ogopogoAspen Smith1-1/+12
turns out emacs over ssh forwarding works well if you use ssh -Y Change-Id: I9c1134d880265b765b0dc52d587ee331fda29f7f Reviewed-on: https://cl.tvl.fyi/c/depot/+/12546 Autosubmit: aspen <root@gws.fyi> Reviewed-by: aspen <root@gws.fyi> Tested-by: BuildkiteCI
2024-09-29 r/8735 feat(aspen/system): Setup a systemd timer to sync the depot public inboxAspen Smith2-4/+29
Change-Id: Iaeae18af25b00b04bd805dabb320c218cb21fd8f Reviewed-on: https://cl.tvl.fyi/c/depot/+/12545 Tested-by: BuildkiteCI Autosubmit: aspen <root@gws.fyi> Reviewed-by: aspen <root@gws.fyi>
2024-09-29 r/8734 chore(tazjin/dotfiles): check in more local configurationVincent Ambo4-1/+21
Instead of installing and configuring fuzzel and wl-clipboard locally, put them into Nix, too. Change-Id: I4b909ac1d0577f8bd176bbaae71583c59aaf5362 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12544 Tested-by: BuildkiteCI Reviewed-by: tazjin <tazjin@tvl.su>
2024-09-29 r/8733 feat(tazjin/dotfiles): configure wlr/taskbar for waybarVincent Ambo2-1/+39
I think that's the last module I was missing for this to be "feature-complete". I think ideally the things displayed by the taskbar would have the same order as the current Niri layout, but I can tackle this later. This might require a patch in Niri. Change-Id: I67cc2366b6c510830021954372e29ce0be7d8363 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12543 Reviewed-by: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-09-29 r/8732 fix(emacs-pkgs/niri): handle non-matching selections adequatelyVincent Ambo1-4/+5
If the user puts in a string that doesn't match any of the selectables, do one of the following: 1. When called inside of Emacs, create a new buffer with that name. 2. When called outside of Emacs, do nothing. Change-Id: I92ba985b5cd7805d37d5d0e0631b20fdce7ce479 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12542 Autosubmit: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI Reviewed-by: tazjin <tazjin@tvl.su>
2024-09-29 r/8731 feat(tazjin/emacs): wire up niri integrationVincent Ambo3-0/+3
Change-Id: Ib0ef3b7cbf4c1dde121e31aa5052145efe350472 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12541 Reviewed-by: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-09-29 r/8730 feat(emacs-pkgs/niri): add command for external switchingVincent Ambo1-15/+91
Adds a command which can invoke something like fuzzel (or any other dmenu compatible system) for the buffer switching logic. This can be invoked as `emacsclient -e (niri-go-anywhere-external)` from any shell, given that the Emacs server is running in the given Emacs. Change-Id: Iafa421e5ad0c3c6cbfecbfc0835e6db878e452e0 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12540 Tested-by: BuildkiteCI Reviewed-by: tazjin <tazjin@tvl.su>
2024-09-29 r/8729 feat(emacs-pkgs/niri): add annotations for buffer targetsVincent Ambo1-0/+15
Adds a completing-read annotation function which can display the "remoteness" of Emacs buffers, as well as the app ID of Niri windows. Change-Id: I15550f7403b91aa4be7076290931da74ac539fac Reviewed-on: https://cl.tvl.fyi/c/depot/+/12536 Reviewed-by: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-09-29 r/8728 feat(emacs-pkgs/niri): functions for seamless niri/emacs switchingVincent Ambo2-0/+96
Introduces a new buffer switching function which is also capable of switching to existing Emacs frames that already display the target buffer, or to other windows displayed in the same Niri session. Not all behaviour is done yet, and there's an explanatory comment in the package with more details. Change-Id: I5a548931a681ba32fdb352ecec66845a75268c19 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12535 Reviewed-by: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-09-29 r/8727 fix(tazjin/dotfiles): minor waybar style fixesVincent Ambo1-1/+2
Change-Id: Iac1fb9856b3783912e505ca0e5228718f42abd4f Reviewed-on: https://cl.tvl.fyi/c/depot/+/12534 Tested-by: BuildkiteCI Reviewed-by: tazjin <tazjin@tvl.su>
2024-09-28 r/8726 chore(tvix/castore/fuse): impl Layer for TvixStoreFsYureka1-1/+12
Allows using a TvixStoreFs in overlay filesystems Change-Id: I10e63c92776b1c783947d92070f360865ef2883c Reviewed-on: https://cl.tvl.fyi/c/depot/+/12539 Autosubmit: yuka <yuka@yuka.dev> Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-09-28 r/8725 chore(tvix/castore/fuse): update fuse-backend-rsYureka4-13/+20
This release includes support for overlay filesystems Change-Id: I946cbf346df045209afaea2d720bb57fc2f2659f Reviewed-on: https://cl.tvl.fyi/c/depot/+/12538 Reviewed-by: flokli <flokli@flokli.de> Autosubmit: yuka <yuka@yuka.dev> Tested-by: BuildkiteCI
2024-09-27 r/8724 refactor(tvix): move refscan module to castoreYureka7-13/+19
This is required to add the optional refscanner parameter to the ingest functions. Change-Id: Ib40a7287cf857eb55e31e0df309a79474fefb518 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12527 Autosubmit: yuka <yuka@yuka.dev> Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-09-26 r/8723 style(tazjin/dotfiles): more authentic win95 waybar stylingVincent Ambo3-74/+154
Brings this a LOT closer to the Windows95 style theming that I'm trying to achieve with the whole thing. Change-Id: Ifb457a682cb83a78e4a8e2ba2bb4a5b96f3eaf1f Reviewed-on: https://cl.tvl.fyi/c/depot/+/12525 Tested-by: BuildkiteCI Autosubmit: tazjin <tazjin@tvl.su> Reviewed-by: tazjin <tazjin@tvl.su>
2024-09-26 r/8722 chore(3p/sources): bump channels & overlays (2024-09-25)Vincent Ambo1-15/+15
Change-Id: I605ca6befee5444901e5a396d626e7b5a9b9a4df Reviewed-on: https://cl.tvl.fyi/c/depot/+/12505 Autosubmit: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org>
2024-09-26 r/8721 feat(whitby): switch from nix-serve to harmonia for the cacheVincent Ambo4-15/+125
Harmonia is, ostensibly, faster and better and, most importantly, not a giant pile of wonky Perl. I've tested locally that Harmonia works with Nix 2.3 (on both ends), so I think we should be good to go here. We have a vendored copy of the upstream module for now. We need to fix Nix 2.3 compatibility in upstream for the module, but the service itself works fine. Change-Id: I3897bb02b83bd466b6fe7077c05728ac49ea4406 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12517 Tested-by: BuildkiteCI Autosubmit: tazjin <tazjin@tvl.su> Reviewed-by: sterni <sternenseemann@systemli.org>
2024-09-26 r/8720 feat(tazjin/home): put niri config in place automaticallyVincent Ambo1-0/+3
This is now stable enough that I can put it under home-manager management. Change-Id: Ifd92ca8951e0adfddf962a4cd845c3e4fe80cc21 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12516 Autosubmit: tazjin <tazjin@tvl.su> Reviewed-by: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-09-26 r/8719 fix(tazjin/home): fix swayidle launch orderVincent Ambo1-0/+1
Change-Id: I2744ae2cef7fc59705b910f48e25289fdea4494d Reviewed-on: https://cl.tvl.fyi/c/depot/+/12515 Reviewed-by: tazjin <tazjin@tvl.su> Autosubmit: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-09-26 r/8718 style(tazjin/dotfiles): theme dunst to not look like crapVincent Ambo1-52/+13
The previous config was copy&pasted from somewhere, this config makes it look like an actual thing instead. Much nicer! Change-Id: I8eb68149964376d6dbe4cef53e86030b5357d17d Reviewed-on: https://cl.tvl.fyi/c/depot/+/12514 Reviewed-by: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-09-26 r/8717 fix(tvix/castore): don't return object_store::has with INFO levelFlorian Klink1-1/+1
This otherwise spams the logs quite a bit, for example when uploading to nar-bridge with the new check from cl/12497. Change-Id: Idc2bcc513caea6fae38ae04489e4e3ee7be64bce Reviewed-on: https://cl.tvl.fyi/c/depot/+/12510 Reviewed-by: yuka <yuka@yuka.dev> Autosubmit: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-09-26 r/8716 feat(tvix/store): Add a signing PathInfoServicesinavir6-0/+225
- Add a new PathInfoService implementation that wraps transparently around another except that it dynamically signs all the incoming path-infos with the provided signer. - Add a ServiceBuilder for this PathInfoService that provides a SigningPathInfoService with a keyfile signer Change-Id: I845ddfdf01d14c503c796b2b80c720dab98be091 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12032 Reviewed-by: flokli <flokli@flokli.de> Autosubmit: sinavir <tvix@sinavir.fr> Tested-by: BuildkiteCI
2024-09-25 r/8715 feat(tvix/store): seekable nar rendererYureka4-0/+535
Co-authored-by: edef <edef@edef.eu> Change-Id: I233206e8aae35504ca0519ac88178dfc5596bedb Reviewed-on: https://cl.tvl.fyi/c/depot/+/12439 Reviewed-by: flokli <flokli@flokli.de> Autosubmit: yuka <yuka@yuka.dev> Tested-by: BuildkiteCI
2024-09-25 r/8714 refactor(tvix/store/tests): combine tests into one parametrized functionYureka2-179/+103
Change-Id: I9ff43b29be68b9840c58286da96fa52927691804 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12507 Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-09-25 r/8713 feat(tvix/eval): Use thiserror for ErrorKind and CatchableErrorKindIlan Joselevich6-250/+113
thiserror is much more easier to maintain than manually implementing Error and Display. Change-Id: Ibf13e2d8a96fba69c8acb362b7515274a593dfd6 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12452 Reviewed-by: flokli <flokli@flokli.de> Autosubmit: Ilan Joselevich <personal@ilanjoselevich.com> Tested-by: BuildkiteCI
2024-09-25 r/8712 chore(tazjin/cursed): don't build this in CIVincent Ambo1-4/+4
Change-Id: Id98daf11a4325ecc077a7c30518066aecfad8182 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12508 Tested-by: BuildkiteCI Reviewed-by: tazjin <tazjin@tvl.su>
2024-09-24 r/8711 fix(tvix/nar-bridge): Remove name check for root node in nar generationsinavir4-16/+27
Nar-bridge tried to parse the name of the protobuf node encoded in the URL into a PathComponent but this name was empty, leading to an error when the user tried to retrieve the nar file. This was an oversight from the conversion to stricter types (some of the CLs in the serious containing cl/12217). We need a version converting a protobuf without a name to our stricter types, but an empty PathComponent cannot be constructed. So we need a into_name_and_node() version that returns the name as Bytes, not PathComponent. Change-Id: I2996cdd2e0107133e502748947298f512f1cc521 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12504 Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-09-23 r/8710 feat(tvix/nix-compat/nar/writer/sync): add file_manual_writeYureka1-0/+68
This is useful for building other NAR writers which use custom (async or optimized) I/O to write the blob parts of the NAR. Change-Id: I447c09914fb0c99044e2fa910d4213660dc51c64 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12437 Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-09-23 r/8709 chore(tazjin/koptevo): allow other device's public keysVincent Ambo1-0/+3
Change-Id: I4955c2cde3cb1ec4d7b72eaaf7f6acc80150dd73 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12503 Reviewed-by: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI Autosubmit: tazjin <tazjin@tvl.su>
2024-09-23 r/8708 fix(tazjin/koptevo): bind quassel on IPv6, tooVincent Ambo1-0/+1
This should make it possible to use Quassel over Yggdrasil. Change-Id: Iad81af7c85771928fd50860393d58a14d7878a40 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12502 Reviewed-by: tazjin <tazjin@tvl.su> Autosubmit: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-09-22 r/8707 feat(aspen/system): Move metrics to ogopogo, refreshAspen Smith13-151/+240
Change-Id: I93ddc961b473e15febe22a16879875dbd926236a Reviewed-on: https://cl.tvl.fyi/c/depot/+/12501 Autosubmit: aspen <root@gws.fyi> Tested-by: BuildkiteCI Reviewed-by: aspen <root@gws.fyi>
2024-09-22 r/8706 feat(aspen/system): Reinstate ddclient, migrate to ogopogoAspen Smith12-312/+33
ddclient is back in nixpkgs and nixos[0], so let's just use that, and remove the backported package from third_party. [0] https://github.com/NixOS/nixpkgs/commit/8a8ec36615daecf2705cab80c3a926a0590eefff Change-Id: Ib14ab68158a6799c78d71e3bea63869ec9fc1a48 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12500 Tested-by: BuildkiteCI Reviewed-by: aspen <root@gws.fyi> Autosubmit: aspen <root@gws.fyi>
2024-09-21 r/8705 chore(ops): remove volgasprint cache machineVincent Ambo2-154/+0
Change-Id: I1030393d843f03af3617487fc70829fcca792839 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12499 Autosubmit: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI Reviewed-by: aspen <root@gws.fyi>
2024-09-19 r/8704 fix(tvix/castore/import): check small blobs firstFlorian Klink1-0/+13
ConcurrentBlobUploader buffers small blobs in memory, and then uploads them to the BlobService in the background. In these cases, we know the hash of the whole blob, so we could check if it exists first before, uploading it. We were however not, and this caused rate limiting issues in GCS, as it has an update limit of one write per second on the same key, which we ran into especially frequently with the empty blob. This reduces the amount of writes of the same blob considerably. In the future, we might be able to drop this, as our chunked blob uploading protocol gets smarter and covers these cases. Change-Id: Icf482df815812f80a0b65cec0426f8e686308abb Reviewed-on: https://cl.tvl.fyi/c/depot/+/12497 Tested-by: BuildkiteCI Autosubmit: flokli <flokli@flokli.de> Reviewed-by: Connor Brewster <cbrewster@hey.com>
2024-09-17 r/8703 chore(3p/sources): bump channels & overlays (2024-09-17)Vincent Ambo4-15/+15
* users/aspen: disable readyset overlay sysbench + postgresql is broken, which breaks the overlay, but I suspect the overlay is no longer needed Change-Id: I1845370c88f5fab35fd700535e6fb0972a4ca556 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12494 Tested-by: BuildkiteCI Autosubmit: tazjin <tazjin@tvl.su> Reviewed-by: flokli <flokli@flokli.de> Reviewed-by: aspen <root@gws.fyi>
generated by cgit-pink 1.4.1 (git 2.44.2) at 2024-11-25T01·13+0000