about summary refs log tree commit diff
AgeCommit message (Collapse)AuthorFilesLines
2024-12-10 r/8998 feat(users/Profpatsch): Implement initial otel-dbus proxyProfpatsch3-67/+755
For simplicity’s sake this puts everything into the alacritty-change-color-scheme script for now. This implements a simple dbus-opentelemetry proxy adapter, which allows services to record otel traces without having to depend on the quite complex otel libraries. Instead, they just send their traces to the dbus tracing interface, and the service that binds against that interface forwards the spans to the OTLP collector. First you create a new Tracer for your service via the `TracerFactory` interface: ``` > busctl --user call \ de.profpatsch.otel.Tracer \ /de/profpatsch/otel/TracerFactory \ de.profpatsch.otel.TracerFactory CreateTracer \ s hello s "/de/profpatsch/otel/tracers/hello" ``` (this corresponds to setting up a tracer with properties in OTEL) Then, you can use the returned object path to call the `Tracer` interface proper: ``` < busctl --user call \ de.profpatsch.otel.Tracer \ /de/profpatsch/otel/tracers/hello \ de.profpatsch.otel.Tracer \ StartSpan \ s '{"spanId": "111", "name": "111"}' ``` This will create the spans. You can also set their timestamps on the sending side via `startTime`/`endTime`, but make sure it’s a hrtime tuple. Prefer batching multiple spans vie the `BatchSpans` call. Change-Id: Ie6cfdcb0dc3e2398316a2c1763bc72c1118168b0 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12885 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de> Reviewed-by: benjaminedwardwebb <benjaminedwardwebb@gmail.com>
2024-12-10 r/8997 feat(pkgs/Profpatsch/alacritty): register color dbus interfaceProfpatsch1-7/+52
Adds a simple-stupid dbus interface for this daemon which allows on-the-fly changing of the alacritty color scheme. Example call: ``` busctl --user call de.profpatsch.alacritty.ColorScheme \ /de/profpatsch/alacritty/ColorScheme \ de.profpatsch.alacritty.ColorScheme \ SetColorScheme s 'prefer-dark' ``` Change-Id: Ic895fedefb3f5bd95f2279edf53fe179e8f24f89 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12875 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-12-10 r/8996 feat(pkgs/Profpatsch/alacritty): init dark mode dbus daemonProfpatsch9-7/+464
A simple dbus daemon that writes the alacritty config to `~/.config/alacritty/alacritty-colors-autogen.toml` on startup and whenever a change between dark/light mode is requested. Alacritty only implements an config file isync watcher, no SIGHUP handler or similar, so we have to actually write the config file lol. This is all a little glue-y, but idk, whatever. Further reading & inspo: https://github.com/alacritty/alacritty/issues/5999 https://www.christianfosli.com/posts/2024-on-colorscheme-changed/ https://github.com/christianfosli/on-colorscheme-changed Change-Id: Iac4eb9d85679dc87e28e57d68384645b3b91d08a Reviewed-on: https://cl.tvl.fyi/c/depot/+/12870 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-12-10 r/8995 fix(users/Profpatsch/whacd-resolver): fix redacted TLDProfpatsch1-2/+2
they switched from .ch to .sh Change-Id: I889634ec257b7956b9d2b22a9ad6fc0c889f43c2 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12853 Reviewed-by: Profpatsch <mail@profpatsch.de> Tested-by: BuildkiteCI
2024-12-10 r/8994 feat(users/Profpatsch): add a example for omega searchProfpatsch1-0/+62
Uses xapian under the hood to index the contents, then makes it searchable with a CGI binary on http://localhost:8080 We could in theory index every -doc output this way to get local documentation search for the current system (similar to `man-db`). Change-Id: I2588c8f100841cfbed570bb65d376b79747c06ee Reviewed-on: https://cl.tvl.fyi/c/depot/+/12710 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-12-10 r/8993 feat(tvix/boot/tests): Replace GNU parallel with rushIlan Joselevich1-3/+3
rush is like GNU parallel, but in Go, and most importantly, without the annoying citation. Change-Id: Id4737e6dee43037c1c2bc814738416410a603e07 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12887 Reviewed-by: flokli <flokli@flokli.de> Autosubmit: Ilan Joselevich <personal@ilanjoselevich.com> Tested-by: BuildkiteCI
2024-12-09 r/8992 docs(tvix/boot): update docstringFlorian Klink1-3/+4
mkBootTest is not limited to only listing files, it can also be used (is used) to boot init. Change-Id: Iaa0d2b5bad3be856aa8a0172450efe166620ba41 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12882 Reviewed-by: Ilan Joselevich <personal@ilanjoselevich.com> Tested-by: BuildkiteCI Autosubmit: flokli <flokli@flokli.de>
2024-12-09 r/8991 refactor(tvix/nix-daemon): use if let Some(_) = …Florian Klink1-8/+4
This makes it a bit less verbose. Change-Id: I41835f43628d7a10855b9d89816e8d20eb7546d2 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12881 Reviewed-by: Ilan Joselevich <personal@ilanjoselevich.com> Reviewed-by: Domen Kožar <domen@cachix.org> Tested-by: BuildkiteCI Autosubmit: flokli <flokli@flokli.de>
2024-12-09 r/8990 docs(nix-compat/nix_daemon): fix typoFlorian Klink1-1/+1
Change-Id: I9bc9982faa0abc8212e15916a3435dd0cfd0e54d Reviewed-on: https://cl.tvl.fyi/c/depot/+/12880 Autosubmit: flokli <flokli@flokli.de> Tested-by: BuildkiteCI Reviewed-by: Domen Kožar <domen@cachix.org> Reviewed-by: Ilan Joselevich <personal@ilanjoselevich.com>
2024-12-09 r/8989 refactor(nix-compat/nix-daemon): s/result/results/Florian Klink1-3/+3
There's more than one result in there. Change-Id: I5d519db51fda050ed293bfb52215a643882e0116 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12879 Tested-by: BuildkiteCI Autosubmit: flokli <flokli@flokli.de> Reviewed-by: Ilan Joselevich <personal@ilanjoselevich.com>
2024-12-07 r/8988 feat(sterni/nix/build): check in toPlainTextsterni1-0/+56
This is a little helper which tries to render different input files into a fancier, human readable plain text form. This is quite useful to gether with build.gopherHole. Change-Id: Ibe0050fa6a55e85745127a287bba0febeeb75849 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12874 Reviewed-by: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI Autosubmit: sterni <sternenseemann@systemli.org>
2024-12-07 r/8987 chore(nix/build): rename to reduce redundancy in attr pathsterni2-4/+2
Change-Id: Ibefb924bb329c2a9dc0ac8e5ee1566253300b5cf Reviewed-on: https://cl.tvl.fyi/c/depot/+/12872 Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org> Autosubmit: sterni <sternenseemann@systemli.org>
2024-12-05 r/8986 chore(tazjin/dotfiles): remove hyper configurationVincent Ambo1-2/+1
I never fully set up the hyper key and now this configuration actually started working by default, which is distracting, so begone! Change-Id: If4c0b5928360087eb1a674ee2eca2510ced3ca55 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12871 Reviewed-by: tazjin <tazjin@tvl.su> Autosubmit: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-12-05 r/8985 chore(3p/lisp/mime4cl): remove MIME-PART-SIZE and MIME-BODY-SIZEsterni4-68/+2
These functions are not very useful—as far as I'm aware at least—, are not implemented very efficiently and totally untested. Remove them for now. See also r/8978. Change-Id: If9d277b460c3ed728a171bc29dd626c4c5fc0313 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12868 Reviewed-by: sterni <sternenseemann@systemli.org> Autosubmit: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI
2024-12-04 r/8984 chore(users/flokli/nixos-tvix-cache): switch to MimirFlorian Klink1-10/+26
VictoriaMetrics doesn't seem to "normalize" timeseries and label names, which causes breakage in Grafana Dashboards querying label values. Reported in VictoriaMetrics/VictoriaMetrics#7744. Change-Id: I3397c4fd5911c9a3503d058c77c26e0db9300f36 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12867 Tested-by: BuildkiteCI Reviewed-by: Jonas Chevalier <zimbatm@zimbatm.com> Reviewed-by: flokli <flokli@flokli.de> Autosubmit: flokli <flokli@flokli.de>
2024-12-04 r/8983 feat(3p/lisp/mime4cl): add benchmark scriptsterni4-1/+100
This is far from comprehensive, mainly covering stuff I'm interested for mblog currently. I should extend it as I go. The cases I've added reveal something I've noticed recently: The worst performing part of mime4cl seems to be the initial parsing of the message. My current theory is that this is due to the use of READ-LINE in DO-MULTIPART-PARTS which seems to ultimately dispatch to READ-CHAR internally due to the way our streams are set up. We should look into fixing this soon. It may be interesting to add this to windtunnel at some point, but I'd rather not burden a runner with this given that mime4cl is only worked on once every blue moon and I'm the only user. Change-Id: I001de3aac01f8aa7ea923b43b2db29cf66a4aac3 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12864 Reviewed-by: sterni <sternenseemann@systemli.org> Autosubmit: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI
2024-12-04 r/8982 chore(tvix): bump tower-otel-http-metrics, enable axum featureFlorian Klink6-19/+71
Move back to a proper release containing the opentelemetry bump. Also enable the `axum` feature, which will give us a per-route accounting. Change-Id: Icdf4dc73588ef45b6596b320c14d9f44946327b3 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12865 Reviewed-by: Ilan Joselevich <personal@ilanjoselevich.com> Autosubmit: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-12-04 r/8981 chore(users/flokli/ipu6-softisp): removeFlorian Klink9-1986/+0
This didn't work properly for a while, at least expose too many cameras for browsers to get confused. It also doesn't apply cleanly to the 6.12.1 kernel. Change-Id: I8a23cc0ae0547bfde5756ee84953b60f4b0a2df2 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12866 Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org> Autosubmit: flokli <flokli@flokli.de>
2024-12-02 r/8980 chore(3p/lisp/closure-*): disable on ECL for nowsterni3-2/+11
As it turns out, some of the load/compile time set up the package does doesn't work in ECL for unknown reasons at the moment. Executables using closure-* will crash after starting up: ;;; Checking for wide character support... WARNING: Lisp implementation doesn't use UTF-16, but accepts surrogate code points. yes, using code points. ;;; Building Closure with CHARACTER RUNES Condition of type: SIMPLE-ERROR Invalid relative pathname #P"package.lisp" for component ("closure-common" "package") Change-Id: I4b4bf96835a39696884ec6fea9c249fdeb53c853 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12863 Reviewed-by: sterni <sternenseemann@systemli.org> Autosubmit: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI
2024-12-02 r/8979 feat(3p/lisp/mime4cl): enable compilation with CCLsterni4-7/+3
Only significant implementation specific code at the moment is FILE-SIZE which isn't very important. We can also easily implement it for CCL. Additionally, we clean up an unused lexical variable warning and remove a duplicate definiton of MIME-TYPE-STRING fro MIME-UNKNOWN-PART that CCL doesn't like. Change-Id: I7c960e50dcdc1d3e46cb4945f36ea315a3c9838d Reviewed-on: https://cl.tvl.fyi/c/depot/+/12862 Autosubmit: sterni <sternenseemann@systemli.org> Reviewed-by: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI
2024-12-02 r/8978 fix(3p/lisp/mime4cl): fix stat function name in FILE-SIZEsterni1-2/+1
This is a silly mistake and was not caught because FILE-SIZE isn't exercised in the test suite. We can probably remove MIME-BODY-SIZE and look into removing MIME-PART-SIZE as well. I just want to be thorough here so that we can revert into a non-broken state in case we decide we need those functions for something. Change-Id: I5bbb3dde6616220fc3b6feddbf7a39b6a9b0ea0d Reviewed-on: https://cl.tvl.fyi/c/depot/+/12861 Autosubmit: sterni <sternenseemann@systemli.org> Reviewed-by: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI
2024-12-02 r/8977 refactor(3p/lisp/mime4cl): drop NATIVE-NAMESTRINGsterni1-5/+0
The only code that used this function was removed in r/7854. Change-Id: Ia07dcb08ed4a92495085b48018372fb9898a0248 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12860 Autosubmit: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org>
2024-12-02 r/8976 fix(sterni/mblog): check for help flags in flag, not arg liststerni1-1/+1
Change-Id: I9f353f7c8f66078b51e333b6b8653f07f7ff544d Reviewed-on: https://cl.tvl.fyi/c/depot/+/12816 Reviewed-by: sterni <sternenseemann@systemli.org> Autosubmit: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI
2024-12-02 r/8975 fix(3p/lisp/mime4cl): don't store redundant headers in MIME-MESSAGEsterni2-7/+230
MIME-MESSAGE has a HEADERS slot which is an alist of all headers. Some of those headers will be parsed again and stored in MIME-PART (or a subclass of it). Having the header content stored in the HEADERS alist and in MIME-PART causes problems: - Requires extra knowledge about how messages are parsed when rendering messages. - Makes MIME= depend on the specific whitespace and quoting in those headers which isn't preserved by how mime4cl parses e.g. Content-Type. - Gives users two ways that slightly diverge to access the same thing. To avoid this, we remove these headers after the MIME-PARTs contained in MIME-MESSAGE have been initialized (since they reuse the HEADERS slot). Change-Id: I5b221f88bbac47dd81db369e3c1d5881a5a50e5e Reviewed-on: https://cl.tvl.fyi/c/depot/+/12858 Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org> Autosubmit: sterni <sternenseemann@systemli.org>
2024-12-02 r/8974 fix(3p/lisp/mime4cl): also default to :7BIT when decodingsterni1-5/+7
Content-Transfer-Encoding should default to 7bit when it's not given (RFC2045). MIME-PART already defaults to this when manually constructing this, but MAKE-MIME-PART would always set it, so it would sometimes be NIL which is incorrect. We now correctly fall back to :7bit in this case. Additionally, we make sure that KEYWORDIFY-ENCODING immediately returns when it's given NIL. Change-Id: I50f86dd649d83a4c3a8881d6e13dcada889d5521 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12857 Reviewed-by: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI Autosubmit: sterni <sternenseemann@systemli.org>
2024-12-02 r/8973 refactor(3p/lisp/mime4cl): streamline MIME-MESSAGE dispatchingsterni1-3/+3
Change-Id: I1fda161e6e128f1bb085a63dd39541894e397d64 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12856 Reviewed-by: sterni <sternenseemann@systemli.org> Autosubmit: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI
2024-12-02 r/8972 fix(3p/lisp/mime4cl): support FILE-PORTION in PRINT-MIME-PARTsterni1-0/+2
Change-Id: I942e8915d5076628179dfa77bf80b7510b862b51 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12855 Autosubmit: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org>
2024-12-02 r/8971 refactor(3p/lisp/mime4cl): eliminate use of READ-CHAR in PRINT-MIME-PARTsterni1-4/+1
Change-Id: Ibb422d3b6720b782620e262bbd3555b9a879ad65 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12854 Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org> Autosubmit: sterni <sternenseemann@systemli.org>
2024-12-01 r/8970 chore(tvix/nix-compat): basic daemon handler testsVova Kryachko5-32/+361
This change adds tests for basic request/response handling as per nix daemon STDERR_* protocol. Change-Id: Ia6a1904e14955551b11f776b6ccb595fa8984513 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12852 Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de> Autosubmit: Vladimir Kryachko <v.kryachko@gmail.com>
2024-11-29 r/8969 refactor(tvix/glue): make user-agent more granularFlorian Klink2-3/+4
Use the crate name in the user-agent, similar to tvix-[ca]store. Change-Id: I10527fb1f29006dbfd8630d8bb1f00d7905efdd3 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12851 Autosubmit: flokli <flokli@flokli.de> Reviewed-by: Vladimir Kryachko <v.kryachko@gmail.com> Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-11-29 r/8968 feat(tvix/castore): set user-agent for object_store blob/directorysvcFlorian Klink3-9/+41
Change-Id: I9fcebffb19174cba2e9001398419d3041266400c Reviewed-on: https://cl.tvl.fyi/c/depot/+/12850 Reviewed-by: Vladimir Kryachko <v.kryachko@gmail.com> Tested-by: BuildkiteCI Autosubmit: flokli <flokli@flokli.de> Reviewed-by: flokli <flokli@flokli.de>
2024-11-29 r/8967 feat(tvix/store): set user-agent for NixHTTPPathInfoServiceFlorian Klink2-3/+11
Change-Id: I8eb74c5a9457b88ab51bd88084591a4c7c5cdbcc Reviewed-on: https://cl.tvl.fyi/c/depot/+/12849 Reviewed-by: Domen Kožar <domen@cachix.org> Autosubmit: flokli <flokli@flokli.de> Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de>
2024-11-28 r/8966 chore(tvix/glue): Fix fetchTarball for github urls.Vova Kryachko1-1/+6
GitHub does not allow downloads by clients without a User-Agent set. This changes sets the client User-Agent to "tvix". Change-Id: I829b37e63bcedb5ea785b55eff5b10175f5caaa6 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12845 Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de>
2024-11-25 r/8965 feat(ops/monorepo-gerrit): link r/<id> shortlinks to revisionssterni1-0/+6
I've decided to use the commit view instead of the log view (which cgit uses) for now. It really depends on how you use it in commit messages: To refer to a depot state or to a specific change (independently of what CL gerrit assigned). I'm happy to change it to use the log view. Change-Id: I472b511fa1322f91304f6543473b51f9c5f21ca2 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12837 Autosubmit: sterni <sternenseemann@systemli.org> Reviewed-by: tazjin <tazjin@tvl.su> Tested-by: BuildkiteCI
2024-11-24 r/8964 feat(tvix/nix-daemon): New operation AddToStoreNarVova Kryachko5-19/+289
This operation is particularly used when invoking the following nix commands: ``` nix-store --add-fixed some-path nix-store --add-fixed --recursive some-path ``` Change-Id: I0f9b129c838c00e10415881f1e6e0d7bc1d7a3a6 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12800 Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de>
2024-11-24 r/8963 feat(tvix/store): Add CAHash validationVova Kryachko9-64/+302
Validation is done inside ingest_nar_and_hash and is used by Fetch::NAR and the nar-bridge. Change-Id: I7e2be4cc13d2447035f1e5a444f44b62339988bf Reviewed-on: https://cl.tvl.fyi/c/depot/+/12836 Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de>
2024-11-24 r/8962 feat(users/flokli/nixos-tvix-cache): re-enable http2Florian Klink1-20/+5
With nar-bridge supporting zstd content-encoding, we don't need the nginx zstd module and can re-enable http2. We also need to propagate the Accept-Encoding sent by the client to nar-bridge, so it actually knows it can send zstd. This reduces the time measured in the microbenchmark from ~13s to this: ``` hyperfine 'rm -rf /tmp/cache; nix copy --from https://nixos.tvix.store/ --to "file:///tmp/cache?compression=none" /nix/store/jlkypcf54nrh4n6r0l62ryx93z752hb2-firefox-132.0' Benchmark 1: rm -rf /tmp/cache; nix copy --from https://nixos.tvix.store/ --to "file:///tmp/cache?compression=none" /nix/store/jlkypcf54nrh4n6r0l62ryx93z752hb2-firefox-132.0 Time (mean ± σ): 4.880 s ± 0.207 s [User: 4.661 s, System: 2.377 s] Range (min … max): 4.700 s … 5.274 s 10 runs ``` Change-Id: Id092307423636163ae95ef87ec8fa558b83ce0bb Reviewed-on: https://cl.tvl.fyi/c/depot/+/12835 Reviewed-by: Jörg Thalheim <joerg@thalheim.io> Autosubmit: flokli <flokli@flokli.de> Tested-by: BuildkiteCI Reviewed-by: Ilan Joselevich <personal@ilanjoselevich.com>
2024-11-24 r/8961 feat(tvix/nar-bridge): support zstd content-encodingFlorian Klink4-16/+52
We previously didn't handle compression in nar-bridge, and left it up to a fronting reverse proxy. However, at least nginx with http2 enabled pins each connection to a single core, causing compression to be limited by the throughput of a single CPU. Change-Id: Ia11c2ff5c012192b25eb8ad05dae5542a2d2f777 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12834 Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de> Autosubmit: flokli <flokli@flokli.de> Reviewed-by: Ilan Joselevich <personal@ilanjoselevich.com> Reviewed-by: Jörg Thalheim <joerg@thalheim.io>
2024-11-23 r/8960 refactor(nix/buildkite): don't calculate deps for skipped targetssterni1-6/+14
We don't need to calculate dependencies between and on targets that are part of the parent target map since they will be skipped by buildkite anyways. This speeds up 🦙 considerably for pipeline runs that have a limited number of changed targets and a parent target map passed in (i.e. pipeline runs of most CLs, but not canon runs). In my testing it was about a minute faster (1/6 of the time 🦙 takes currently) for a pipeline where under five drv targets changed. For the full pipeline (i.e. no parentTargetMap) 🦙 takes about the same time as before (it's a few seconds slower as is to be expected, but nothing significant). Change-Id: Ia5a80e142da8f40bc591e2c6cfaf48c325b2f577 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12818 Reviewed-by: tazjin <tazjin@tvl.su> Autosubmit: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI
2024-11-23 r/8959 chore(tvix/nix-compat-derive-tests): update fixturesFlorian Klink1-5/+5
With more implementing NixDeserialize, this error message changed. Fixtures were regenerated by running: ``` TRYBUILD=overwrite cargo test -p nix-compat-derive-tests --all-features ``` Unfortunately, it's not possible to loop this into CI, as trybuild invokes cargo during the build. Change-Id: Ia0ab07d0907d21366845fe06e01df9fb1fe3e7cb Reviewed-on: https://cl.tvl.fyi/c/depot/+/12831 Autosubmit: flokli <flokli@flokli.de> Reviewed-by: Ilan Joselevich <personal@ilanjoselevich.com> Tested-by: BuildkiteCI
2024-11-23 r/8958 refactor(users/flokli/nixos-tvix-cache): absorb otlpcollector into alloyFlorian Klink1-49/+33
We don't need a separate instance of opentelemetry-collector, alloy can also do this job for us. Change-Id: I1b671ba57d70b080f7db112e1afcfe2e0cbdd13e Reviewed-on: https://cl.tvl.fyi/c/depot/+/12829 Reviewed-by: flokli <flokli@flokli.de> Reviewed-by: Jonas Chevalier <zimbatm@zimbatm.com> Tested-by: BuildkiteCI
2024-11-23 r/8957 fix(users/flokli/nixos-tvix-cache): bump max_traces_per_userFlorian Klink1-0/+2
These are quite bursty, and I've seen messages about getting rate limited. Change-Id: I73058140957cb5718971fa432c003c2d1b0305e3 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12828 Tested-by: BuildkiteCI Reviewed-by: Ilan Joselevich <personal@ilanjoselevich.com>
2024-11-23 r/8956 feat(users/flokli/nixos/nixos-tvix-cache): also collect system metricszimbatm1-0/+26
Use grafana-alloy to collect system metrics. Change-Id: I592e64ca722701d4f12e69a531a434b54954955a Reviewed-on: https://cl.tvl.fyi/c/depot/+/12827 Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-11-23 r/8955 fix(tvix/nar-bridge): explicitly select fields to add to spanFlorian Klink2-5/+5
We got some double-quoted strings at narinfo_str, and it didn't align well with our other field names. Change-Id: I5c08786d2c4435542bf39ff44b9d4ada5400550d Reviewed-on: https://cl.tvl.fyi/c/depot/+/12826 Tested-by: BuildkiteCI Reviewed-by: Ilan Joselevich <personal@ilanjoselevich.com>
2024-11-23 r/8954 fix(tvix/castore): instrument blob uploads with current spanFlorian Klink1-0/+2
Change-Id: I67e18486c48f06787fad8be506e95eecc23e994d Reviewed-on: https://cl.tvl.fyi/c/depot/+/12825 Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI Reviewed-by: Jonas Chevalier <zimbatm@zimbatm.com>
2024-11-23 r/8953 fix(tvix/nar-bridge): set correct service nameFlorian Klink1-1/+1
We should be able to distinguish tvix-store and nar-bridge. Change-Id: I616c8e0c1ce2dbacab92975582dd36141b673aa2 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12824 Reviewed-by: Ilan Joselevich <personal@ilanjoselevich.com> Tested-by: BuildkiteCI
2024-11-23 r/8952 feat(tvix/nar-bridge): wire up metrics layerFlorian Klink7-5/+112
This provides some global HTTP statistics. Change-Id: I8bd3e034123154a49d94720b0c8d0c3babde5ae3 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12557 Reviewed-by: Jonas Chevalier <zimbatm@zimbatm.com> Tested-by: BuildkiteCI Reviewed-by: flokli <flokli@flokli.de>
2024-11-23 r/8951 feat(tvix/tracing): configure metrics supportFlorian Klink1-25/+69
This creates and registers a global meter provider, which uses the same mechanism to get notified of flushes. Change-Id: I856a67f0b282d494de3b2c2a1b79c06ae8ffe252 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12556 Reviewed-by: Jonas Chevalier <zimbatm@zimbatm.com> Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI
2024-11-23 r/8950 feat(users/flokli/nixos/nixos-tvix-cache): collect metricsFlorian Klink1-57/+61
This enables routing of metrics to an instance of VictoriaMetrics, and configures opentelemetry-collector to route metrics there. Change-Id: If765191a4cc70ddcaad821d45132b96a10a12148 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12812 Reviewed-by: flokli <flokli@flokli.de> Tested-by: BuildkiteCI Reviewed-by: Jonas Chevalier <zimbatm@zimbatm.com>
2024-11-23 r/8949 feat(users/flokli/nixos/nixos-tvix-cache): initFlorian Klink8-0/+555
This is a fetch-through mirror of cache.nixos.org, hosted by NumTide. The current machine is a SX65 Hetzner dedicated server with 4x22TB SATA disks, and 2x1TB NVMe disks. The goals of this machine: - Exercise tvix-store and nar-bridge code - Collect usage metrics (see https://nixos.tvix.store/grafana) - Identify bottlenecks - Replace cache.nixos.org? Be however aware that there's zero availability guarantees. Since Tvix doesn't support garbage collection yet, we either will delete data or order a bigger box. Change-Id: Id24baa18cae1629a06caaa059c0c75d4a01659d5 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12811 Tested-by: BuildkiteCI Reviewed-by: Jonas Chevalier <zimbatm@zimbatm.com> Reviewed-by: flokli <flokli@flokli.de>