diff options
author | Aspen Smith <root@gws.fyi> | 2023-12-14T19·21-0500 |
---|---|---|
committer | grfn <grfn@gws.fyi> | 2023-12-14T19·34+0000 |
commit | 1d678bab5f760b9141feefeacf4a27f72ae1adbd (patch) | |
tree | b91b0ac943d68d4c261477a768641b065912f6a5 /tvix/scripts/bench.sh | |
parent | e4d6d20aa7edf82a741b349b520242cd7381aa2e (diff) |
fix(tvix): Fix tvix nixpkgs eval benchmark r/7220
Fix the nixpkgs eval hyperfine benchmark in tvix/scripts.bench.sh to: - Eval both a pinned (never-changing) nixpkgs commit and the nixpkgs commit used by the depot - Not depend on fetchTarball, which is not yet implemented. - Be called bench-windtunnel.sh Change-Id: Id2ae18f983ab7327625320b5b16c082ecc369a49 Reviewed-on: https://cl.tvl.fyi/c/depot/+/10364 Reviewed-by: flokli <flokli@flokli.de> Autosubmit: grfn <grfn@gws.fyi> Tested-by: BuildkiteCI
Diffstat (limited to 'tvix/scripts/bench.sh')
-rwxr-xr-x | tvix/scripts/bench.sh | 21 |
1 files changed, 0 insertions, 21 deletions
diff --git a/tvix/scripts/bench.sh b/tvix/scripts/bench.sh deleted file mode 100755 index 548a9d2058d3..000000000000 --- a/tvix/scripts/bench.sh +++ /dev/null @@ -1,21 +0,0 @@ -#!/usr/bin/env nix-shell -#!nix-shell -i bash ../.. -A tvix.shell - -# Benchmark script that runs inside the Windtunnel build agent - -set -euo pipefail - -echo "Running benchmarks for tvix/eval..." -pushd "$(dirname "$(dirname "$0")")/eval" -cargo bench -windtunnel-cli report -f criterion-rust . -popd - -echo "Running tvix macrobenchmarks..." -pushd "$(dirname "$(dirname "$0")")" -cargo build --release --bin tvix -hyperfine --export-json ./results.json \ - -n 'eval-nixpkgs-hello' "target/release/tvix -E '(import ../../nixpkgs {}).hello.outPath'" \ - -n 'eval-nixpkgs-cross-hello' "target/release/tvix -E '(import ../../nixpkgs {}).pkgsCross.aarch64-multiplatform.hello.outPath'" -windtunnel-cli report -f hyperfine-json ./results.json -popd |