depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2016-11-25	Get rid of unicode quotes (#1140)	Guillaume Maudoux	28	-314/+314

2016-11-17	Update darwin build for optional sandbox paths	Shea Levy	1	-3/+6
	Fixes #1132
2016-11-16	S3BinaryCacheStore:: Eliminate a string copy while uploading	Eelco Dolstra	2	-2/+2
	This cuts hydra-queue-runner's peak memory usage by about a third.
2016-11-14	buildPaths(): Handle ecIncompleteClosure	Eelco Dolstra	1	-1/+1
	buildPaths() on a non-derivation would incorrectly not throw an error if the path didn't have a substitute.
2016-11-14	Don't rely on %m	Eelco Dolstra	1	-1/+2

2016-11-14	daemon: Do not error out when deduplication fails due to ENOSPC.	Ludovic Courtès	1	-5/+19
	This solves a problem whereby if /gnu/store/.links had enough entries, ext4's directory index would be full, leading to link(2) returning ENOSPC. * nix/libstore/optimise-store.cc (LocalStore::optimisePath_): Upon ENOSPC from link(2), print a message and return instead of throwing a 'SysError'.
2016-11-10	Store::computeFSClosure(): Support a set of paths	Eelco Dolstra	3	-7/+18
	This way, callers can exploits the parallelism of computeFSClosure() when they have multiple paths that they need the (combined) closure of.
2016-11-09	copyClosure() / copyStorePath(): Expose dontCheckSigs	Eelco Dolstra	2	-6/+6
	Needed by Hydra.
2016-11-09	Merge branch 'ssh-store' of https://github.com/shlevy/nix	Eelco Dolstra	10	-86/+355

2016-11-09	Implement backwards-compatible RemoteStore::addToStore()	Eelco Dolstra	1	-1/+22
	The SSHStore PR adds this functionality to the daemon, but we have to handle the case where the Nix daemon is 1.11. Also, don't require signatures for trusted users. This restores 1.11 behaviour. Fixes https://github.com/NixOS/hydra/issues/398.
2016-11-08	Typo	Eelco Dolstra	1	-1/+1

2016-10-31	Support optional sandbox paths	Eelco Dolstra	1	-9/+26
	For example, you can now set build-sandbox-paths = /dev/nvidiactl? to specify that /dev/nvidiactl should only be mounted in the sandbox if it exists in the host filesystem. This is useful e.g. for EC2 images that should support both CUDA and non-CUDA instances.
2016-10-27	Add nix.conf options for -k and -K	Shea Levy	1	-0/+2
	Fixes #1084
2016-10-26	Fix build log output in nix-store --serve	Eelco Dolstra	1	-1/+1

2016-10-26	Restore the CachedFailure status code	Eelco Dolstra	1	-0/+4
	The removal of CachedFailure caused the value of TimedOut to change, which broke timed-out handling in Hydra (so timed-out builds would show up as "aborted" and would be retried, e.g. at http://hydra.nixos.org/build/42537427).
2016-10-21	Remove addPathToAccessor	Eelco Dolstra	8	-108/+96

2016-10-21	BinaryCacheStore: Optionally write a NAR listing	Eelco Dolstra	10	-20/+81
	The store parameter "write-nar-listing=1" will cause BinaryCacheStore to write a file ‘<store-hash>.ls.xz’ for each ‘<store-hash>.narinfo’ added to the binary cache. This file contains an XZ-compressed JSON file describing the contents of the NAR, excluding the contents of regular files. E.g. { "version": 1, "root": { "type": "directory", "entries": { "lib": { "type": "directory", "entries": { "Mcrt1.o": { "type": "regular", "size": 1288 }, "Scrt1.o": { "type": "regular", "size": 3920 }, } } } ... } } (The actual file has no indentation.) This is intended to speed up the NixOS channels programs index generator [1], since fetching gazillions of large NARs from cache.nixos.org is currently a bottleneck for updating the regular (non-small) channel. [1] https://github.com/NixOS/nixos-channel-scripts/blob/master/generate-programs-index.cc
2016-10-19	Merge branch 'priorityqueue' of https://github.com/groxxda/nix	Eelco Dolstra	1	-12/+17

2016-10-19	Shut up clang warning	Eelco Dolstra	1	-1/+1

2016-10-19	Fix uninitialised variable	Eelco Dolstra	1	-1/+1

2016-10-18	downloader: use priority_queue	Alexander Ried	1	-12/+17

2016-10-14	Fix /dev/ptmx in sandboxes	Eelco Dolstra	1	-1/+6
	This was broken since ff0c0b645cc1448959126185bb2fafe41cf0bddf. Since I can't figure out how to mount a devpts instance in the sandbox, let's just bind-mount the host devpts.
2016-10-14	CURL_AT_LEAST_VERSION -> LIBCURL_VERSION_NUM	Eelco Dolstra	1	-4/+3
	http://hydra.nixos.org/build/42025230
2016-10-13	Fix HTTP/2 support	Eelco Dolstra	1	-3/+3
	Commit 86e8c67efc33cf756500a1dec7fd6313658f2664 broke it, because CURL_* are not actually #defines.
2016-10-13	SSL_CERT_FILE -> NIX_SSL_CERT_FILE	Eelco Dolstra	1	-1/+2
	This prevents collisions with the "native" OpenSSL, in particular on OS X. Fixes #921.
2016-10-12	Shut up some warnings	Eelco Dolstra	1	-1/+1

2016-10-07	querySubstitutablePaths(): Don't query paths for which we already have a ↵	Eelco Dolstra	1	-3/+16
	substituter
2016-10-07	LocalStore::querySubstitutablePaths(): Implement using queryValidPaths()	Eelco Dolstra	1	-7/+3

2016-10-07	Store::queryValidPaths(): Use async queryPathInfo()	Eelco Dolstra	1	-4/+39
	This allows the binary cache substituter to pipeline requests.
2016-10-07	Implement generic Store::queryValidPaths()	Eelco Dolstra	3	-4/+12

2016-10-07	Add copyClosure utility function for Hydra	Eelco Dolstra	2	-0/+29

2016-10-07	importPaths(): Fix accessor support for Hydra	Eelco Dolstra	4	-7/+27

2016-10-06	Fix getS3Stats()	Eelco Dolstra	2	-2/+2

2016-10-05	Use std::random_device	Eelco Dolstra	1	-0/+1

2016-10-04	Fix build with older versions of libcurl	Eelco Dolstra	1	-0/+6

2016-09-22	Handle the case where signed-binary-caches consists of whitespace	Eelco Dolstra	1	-1/+1

2016-09-21	Add sandbox-dev-shm-size option	Eelco Dolstra	1	-1/+2
	Fixes #1069.
2016-09-21	printMsg(lvlError, ...) -> printError(...) etc.	Eelco Dolstra	11	-80/+80

2016-09-21	Some notational convenience for formatting strings	Eelco Dolstra	2	-4/+4
	We can now write throw Error("file '%s' not found", path); instead of throw Error(format("file '%s' not found") % path); and similarly printError("file '%s' not found", path); instead of printMsg(lvlError, format("file '%s' not found") % path);
2016-09-20	Tweak	Eelco Dolstra	1	-5/+1

2016-09-20	Improve robustness	Eelco Dolstra	1	-2/+6

2016-09-20	Fix "Promise already satisfied" error	Eelco Dolstra	1	-1/+3

2016-09-16	armv5tel can be built by armv6l and armv7l (#1063)	Eric Litak	1	-0/+1

2016-09-16	Make computeFSClosure() single-threaded again	Eelco Dolstra	14	-202/+335
	The fact that queryPathInfo() is synchronous meant that we needed a thread for every concurrent binary cache lookup, even though they end up being handled by the same download thread. Requiring hundreds of threads is not a good idea. So now there is an asynchronous version of queryPathInfo() that takes a callback function to process the result. Similarly, enqueueDownload() now takes a callback rather than returning a future. Thus, a command like nix path-info --store https://cache.nixos.org/ -r /nix/store/slljrzwmpygy1daay14kjszsr9xix063-nixos-16.09beta231.dccf8c5 that returns 4941 paths now takes 1.87s using only 2 threads (the main thread and the downloader thread). (This is with a prewarmed CloudFront.)
2016-09-14	Revive binary-caches-parallel-connections	Eelco Dolstra	1	-2/+8
	It's a slight misnomer now because it actually limits all downloads, not just binary cache lookups. Also add a "enable-http2" option to allow disabling use of HTTP/2 (enabled by default).
2016-09-14	Enable HTTP/2 support	Eelco Dolstra	4	-199/+422
	The binary cache store can now use HTTP/2 to do lookups. This is much more efficient than HTTP/1.1 due to multiplexing: we can issue many requests in parallel over a single TCP connection. Thus it's no longer necessary to use a bunch of concurrent TCP connections (25 by default). For example, downloading 802 .narinfo files from https://cache.nixos.org/, using a single TCP connection, takes 11.8s with HTTP/1.1, but only 0.61s with HTTP/2. This did require a fairly substantial rewrite of the Downloader class to use the curl multi interface, because otherwise curl wouldn't be able to do multiplexing for us. As a bonus, we get connection reuse even with HTTP/1.1. All downloads are now handled by a single worker thread. Clients call Downloader::enqueueDownload() to tell the worker thread to start the download, getting a std::future to the result.
2016-09-14	Move some .drv parsing functions out of util	Eelco Dolstra	1	-0/+46

2016-09-12	ssh-store: Start master on-demand	Shea Levy	1	-8/+13

2016-09-12	Inline ssh-store.hh into ssh-store.cc	Shea Levy	2	-41/+34

2016-09-08	Don't run builds as root in the user namespace	Eelco Dolstra	1	-16/+31
	This largely reverts c68e5913c71badc89ff346d1c6948517ba720c93. Running builds as root breaks "cp -p", since when running as root, "cp -p" assumes that it can succesfully chown() files. But that's not actually the case since the user namespace doesn't provide a complete uid mapping. So it barfs with a fatal error message ("cp: failed to preserve ownership for 'foo': Invalid argument").