about summary refs log tree commit diff
path: root/tvix/scripts/bench.sh
diff options
context:
space:
mode:
authorAspen Smith <root@gws.fyi>2023-12-14T19·21-0500
committergrfn <grfn@gws.fyi>2023-12-14T19·34+0000
commit1d678bab5f760b9141feefeacf4a27f72ae1adbd (patch)
treeb91b0ac943d68d4c261477a768641b065912f6a5 /tvix/scripts/bench.sh
parente4d6d20aa7edf82a741b349b520242cd7381aa2e (diff)
fix(tvix): Fix tvix nixpkgs eval benchmark r/7220
Fix the nixpkgs eval hyperfine benchmark in tvix/scripts.bench.sh to:

- Eval both a pinned (never-changing) nixpkgs commit and the nixpkgs
  commit used by the depot
- Not depend on fetchTarball, which is not yet implemented.
- Be called bench-windtunnel.sh

Change-Id: Id2ae18f983ab7327625320b5b16c082ecc369a49
Reviewed-on: https://cl.tvl.fyi/c/depot/+/10364
Reviewed-by: flokli <flokli@flokli.de>
Autosubmit: grfn <grfn@gws.fyi>
Tested-by: BuildkiteCI
Diffstat (limited to '')
-rwxr-xr-xtvix/scripts/bench.sh21
1 files changed, 0 insertions, 21 deletions
diff --git a/tvix/scripts/bench.sh b/tvix/scripts/bench.sh
deleted file mode 100755
index 548a9d2058..0000000000
--- a/tvix/scripts/bench.sh
+++ /dev/null
@@ -1,21 +0,0 @@
-#!/usr/bin/env nix-shell
-#!nix-shell -i bash ../.. -A tvix.shell
-
-# Benchmark script that runs inside the Windtunnel build agent
-
-set -euo pipefail
-
-echo "Running benchmarks for tvix/eval..."
-pushd "$(dirname "$(dirname "$0")")/eval"
-cargo bench
-windtunnel-cli report -f criterion-rust .
-popd
-
-echo "Running tvix macrobenchmarks..."
-pushd "$(dirname "$(dirname "$0")")"
-cargo build --release --bin tvix
-hyperfine --export-json ./results.json \
-    -n 'eval-nixpkgs-hello' "target/release/tvix -E '(import ../../nixpkgs {}).hello.outPath'" \
-    -n 'eval-nixpkgs-cross-hello' "target/release/tvix -E '(import ../../nixpkgs {}).pkgsCross.aarch64-multiplatform.hello.outPath'"
-windtunnel-cli report -f hyperfine-json ./results.json
-popd