about summary refs log tree commit diff
AgeCommit message (Collapse)AuthorFilesLines
2017-12-07 Provide random access to cached NARsEelco Dolstra5-104/+198
E.g. $ time nix cat-store --store https://cache.nixos.org?local-nar-cache=/tmp/nars \ /nix/store/b0w2hafndl09h64fhb86kw6bmhbmnpm1-blender-2.79/share/icons/hicolor/scalable/apps/blender.svg > /dev/null real 0m4.139s $ time nix cat-store --store https://cache.nixos.org?local-nar-cache=/tmp/nars \ /nix/store/b0w2hafndl09h64fhb86kw6bmhbmnpm1-blender-2.79/share/icons/hicolor/scalable/apps/blender.svg > /dev/null real 0m0.024s (Before, the second call took ~0.220s.) This will use a NAR listing in /tmp/nars/b0w2hafndl09h64fhb86kw6bmhbmnpm1.ls containing all metadata, including the offsets of regular files inside the NAR. Thus, we don't need to read the entire NAR. (We do read the entire listing, but that's generally pretty small. We could use a SQLite DB by borrowing some more code from nixos-channel-scripts/file-cache.hh.) This is primarily useful when Hydra is serving files from an S3 binary cache, in particular when you have giant NARs. E.g. we had some 12 GiB NARs, so accessing individuals files was pretty slow.
2017-12-07 nix ls-{nar,store}: Return offset of files in the NAR if knownEelco Dolstra3-9/+12
E.g. $ nix ls-store --json --recursive --store https://cache.nixos.org /nix/store/b0w2hafndl09h64fhb86kw6bmhbmnpm1-blender-2.79 \ | jq .entries.bin.entries.blender.narOffset 400
2017-12-06 Merge pull request #1714 from LnL7/fix-ssh-store-narEelco Dolstra1-3/+3
ssh-store: fix length when writing nar
2017-12-06 ssh-store: fix length when writing narDaiderd Jordan1-3/+3
This fixes nix copy and other things that use copyStorePath.
2017-12-05 Merge branch 'fetchGit-fast-revision-update'Shea Levy3-24/+43
2017-12-04 Simplify build by including nlohmann/json.hppEelco Dolstra4-4/+14724
2017-12-04 Fix #1635.Eelco Dolstra1-3/+18
2017-11-29 Merge pull request #1704 from lheckemann/buildenv-eol-fixEelco Dolstra1-2/+2
Fix "Unexpected EOF reading a line" error
2017-11-29 Fix "Unexpected EOF reading a line" errorLinus Heckemann1-2/+2
propagated-user-env-packages files in nixpkgs aren't all terminated by newlines, as buildenv expected. Now it does not require a terminating newline; note that this introduces a behaviour change: propagated user env packages may now be spread across multiple lines. However, nix 1.11.x still expects them to be on a single line so this shouldn't be used in nixpkgs for now.
2017-11-28 Show log tail when a remote build failsEelco Dolstra1-2/+2
2017-11-27 Merge pull request #1699 from aszlig/fix-remote-build-logEelco Dolstra2-2/+5
build-remote: Fix missing log output
2017-11-25 build-remote: Fix missing log outputaszlig2-2/+5
The storeUri variable in the build-remote hook is declared very much to the start of the main function and a bunch of lines later, the same variable gets checked via hasPrefix() but it gets assigned *after* that check when the most suitable machine for the build was choosen. So I guess this was just a typo in d16fd2497374671c92cb877f9570d65783a7 and what we really want is to either checkd the prefix *after* assigning storeUri or use bestMachine->storeUri directly. I choose the latter, because the former could introduce even more regressions if the try block where the variable gets assigned terminates early. Nevertheless, the reason why the log output didn't work is because hasPrefix() checked for "ssh://" in front of storeUri, but if the storeUri isn't set correctly (or at all), we don't get the log file descriptor set up properly, leading to no log output. I've adjusted the remote-builds test to include a regression test for this, so that we can make sure we get a build output when using remote builds. In addition to that I've tested this with two of my build farms and the build logs are emitted correctly again. Signed-off-by: aszlig <aszlig@nix.build>
2017-11-24 nix path-info: Show URL of NARs in binary cachesEelco Dolstra1-0/+2
2017-11-24 nix-shell/nix-build: Support .drv files againEelco Dolstra6-4/+61
Fixes #1663. Also handle '!<output-name>' (#1694).
2017-11-24 fetchGit: Ignore tarballTtl if rev is set and not in the repo.Shea Levy3-24/+43
Fixes #1697.
2017-11-21 tests/run.sh: Fix /build conflict when building in a sandboxEelco Dolstra1-1/+3
https://hydra.nixos.org/build/64519355
2017-11-21 fetchGit/fetchMercurial: Fix directory inclusion checkEelco Dolstra4-6/+12
E.g. the existence of .gitignore would cause .git to be included.
2017-11-21 Propagate flags like --sandbox to the daemon properlyEelco Dolstra3-6/+12
2017-11-21 Add a warning about the 'trusted-users' optionEelco Dolstra1-5/+6
2017-11-20 Add tests for verifying/copying content-addressed pathsEelco Dolstra1-1/+14
These don't require signatures.
2017-11-20 Add tests for signature checking when copying between local storesEelco Dolstra1-0/+20
2017-11-20 Document secret-key-filesEelco Dolstra1-3/+16
2017-11-20 Add tests for "nix run"Eelco Dolstra3-1/+46
2017-11-20 nix eval --raw: Use coerceToString()Eelco Dolstra1-2/+6
Thus, $ nix eval --raw '("foo")' foo $ nix eval --raw nixpkgs.hello /nix/store/1y6ckg6khrdsvll54s5spcmf3w6ka9k4-hello-2.10 $ nix eval --raw '(/etc/resolv.conf)' /nix/store/vml92ama92i8mz013nny461mlvg8mvap-resolv.conf
2017-11-20 nix run: Fix "flag '--command' requires 2 argument(s)"Eelco Dolstra1-1/+1
2017-11-20 nix run: Fix accidental removal of /nix/store existence checkEelco Dolstra1-1/+1
Parenthetical to #1686, we don't need to create a new root if we can just bind-mount on top of the existing /nix/store.
2017-11-20 nix run: Ignore non-directories while setting up the chrootEelco Dolstra1-3/+6
Fixes #1686.
2017-11-20 Test: Replace --option with the corresponding flagEelco Dolstra11-45/+45
2017-11-20 signed-binary-caches -> require-sigsEelco Dolstra5-17/+25
Unlike signed-binary-caches (which could only be '*' or ''), require-sigs is a proper Boolean option. The default is true.
2017-11-20 CleanupEelco Dolstra1-2/+2
2017-11-20 binary-cache-public-keys -> trusted-public-keysEelco Dolstra5-19/+20
The name had become a misnomer since it's not only for substitution from binary caches, but when adding/copying any (non-content-addressed) path to a store.
2017-11-20 install-darwin-multi-user.sh: Remove superfluous nix.conf settingsEelco Dolstra1-8/+0
2017-11-20 Merge pull request #1645 from twhitehead/stat-raceEelco Dolstra1-12/+11
Fix (highly unlikely) race condition in readLink
2017-11-20 nix copy: Abbreviate "daemon"Eelco Dolstra1-2/+2
2017-11-15 Add a "profile" option to S3BinaryCacheStoreEelco Dolstra3-5/+14
This allows specifying the AWS configuration profile to use. E.g. nix copy --from s3://my-cache?profile=aws-dev-account /nix/store/cf3isrlqavvd5w7rpky1fa8j9lcnlggm-...
2017-11-15 Merge pull request #1678 from dtzWill/feature/anchor-exit-exceptionEelco Dolstra2-0/+2
anchor nix::Exit exception
2017-11-15 DohEelco Dolstra1-0/+11
2017-11-14 anchor nix::Exit exceptionWill Dietz2-0/+2
2017-11-14 Add dependencies for coverage testEelco Dolstra1-1/+1
2017-11-14 Update lcov filterEelco Dolstra1-1/+1
2017-11-14 nix sign-paths: Support binary cachesEelco Dolstra3-15/+43
2017-11-14 Add tests for "nix verify", "nix sign-paths" etc.Eelco Dolstra2-1/+64
2017-11-14 Revert "Don't parse "x:x" as a URI"Eelco Dolstra3-4/+3
This reverts commit f90f660b243866b8860eeb24cc4a345d32cc7ce7. This broke Hydra's release.nix, which contained preCheck = ''export LOGNAME=${LOGNAME:-foo}'';
2017-11-14 nix ls-{nar,store}: Don't abort on missing filesEelco Dolstra2-1/+5
2017-11-14 Add some testsEelco Dolstra1-4/+15
2017-11-14 nix ls-{nar,store} --json: Respect -REelco Dolstra4-6/+13
2017-11-14 Don't indent JSON outputEelco Dolstra4-4/+4
2017-11-14 nix ls-{store,nar}: Add --json flagEelco Dolstra4-40/+53
2017-11-14 Remove ncurses-binEelco Dolstra1-1/+1
2017-11-14 Make config options available to legacy commandsEelco Dolstra2-4/+4