depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2016-11-09	Merge branch 'ssh-store' of https://github.com/shlevy/nix	Eelco Dolstra	1	-4/+3

2016-10-21	Remove addPathToAccessor	Eelco Dolstra	1	-75/+77

2016-10-21	BinaryCacheStore: Optionally write a NAR listing	Eelco Dolstra	1	-9/+64
	The store parameter "write-nar-listing=1" will cause BinaryCacheStore to write a file ‘<store-hash>.ls.xz’ for each ‘<store-hash>.narinfo’ added to the binary cache. This file contains an XZ-compressed JSON file describing the contents of the NAR, excluding the contents of regular files. E.g. { "version": 1, "root": { "type": "directory", "entries": { "lib": { "type": "directory", "entries": { "Mcrt1.o": { "type": "regular", "size": 1288 }, "Scrt1.o": { "type": "regular", "size": 3920 }, } } } ... } } (The actual file has no indentation.) This is intended to speed up the NixOS channels programs index generator [1], since fetching gazillions of large NARs from cache.nixos.org is currently a bottleneck for updating the regular (non-small) channel. [1] https://github.com/NixOS/nixos-channel-scripts/blob/master/generate-programs-index.cc
2016-10-07	importPaths(): Fix accessor support for Hydra	Eelco Dolstra	1	-0/+8

2016-09-16	Make computeFSClosure() single-threaded again	Eelco Dolstra	1	-6/+26
	The fact that queryPathInfo() is synchronous meant that we needed a thread for every concurrent binary cache lookup, even though they end up being handled by the same download thread. Requiring hundreds of threads is not a good idea. So now there is an asynchronous version of queryPathInfo() that takes a callback function to process the result. Similarly, enqueueDownload() now takes a callback rather than returning a future. Thus, a command like nix path-info --store https://cache.nixos.org/ -r /nix/store/slljrzwmpygy1daay14kjszsr9xix063-nixos-16.09beta231.dccf8c5 that returns 4941 paths now takes 1.87s using only 2 threads (the main thread and the downloader thread). (This is with a prewarmed CloudFront.)
2016-09-02	Factor a general remote FS accessor out of BinaryCacheStore	Shea Levy	1	-64/+2

2016-08-10	FSAccessor: Throw InvalidPath	Eelco Dolstra	1	-1/+1

2016-07-26	makeFixedOutputPath(): Drop superfluous HashType argument	Eelco Dolstra	1	-1/+1

2016-06-01	Make the store directory a member variable of Store	Eelco Dolstra	1	-7/+8

2016-05-31	nix-copy-closure / build-remote.pl: Disable signature checking	Eelco Dolstra	1	-1/+2
	This restores the Nix 1.11 behaviour.
2016-05-30	Re-implement the WantMassQuery property of binary caches	Eelco Dolstra	1	-1/+20

2016-05-30	BinaryCacheStore: Remove buildPaths() / ensurePath()	Eelco Dolstra	1	-61/+2

2016-05-04	Add a Store::addToStore() variant that accepts a NAR	Eelco Dolstra	1	-91/+14
	As a side effect, this ensures that signatures are propagated when copying paths between stores. Also refactored import/export to make use of this.
2016-05-04	Remove OpenSSL-based signing	Eelco Dolstra	1	-6/+3

2016-04-29	BinaryCacheStore: Support bzip2 compression	Eelco Dolstra	1	-1/+4

2016-04-29	Better error message	Eelco Dolstra	1	-1/+6

2016-04-29	BinaryCacheStore: Support "none" compression method	Eelco Dolstra	1	-23/+18

2016-04-29	BinaryCacheStore: Make the signing key a parameter	Eelco Dolstra	1	-1/+2

2016-04-29	BinaryCacheStore::queryPathInfo: Don't check signatures	Eelco Dolstra	1	-9/+1
	Other stores don't do this either. It's up to the caller to check signatures.
2016-04-28	Fix error message	Eelco Dolstra	1	-1/+1

2016-04-22	BinaryCacheStore: When adding a path, ensure the references are valid	Eelco Dolstra	1	-0/+11
	This prevents copying a partial closure to a binary cache.
2016-04-21	Implement S3BinaryCacheStore::queryAllValidPaths()	Eelco Dolstra	1	-4/+4
	This allows commands like "nix verify --all" or "nix path-info --all" to work on S3 caches. Unfortunately, this requires some ugly hackery: when querying the contents of the bucket, we don't want to have to read every .narinfo file. But the S3 bucket keys only include the hash part of each store path, not the name part. So as a special exception queryAllValidPaths() can now return store paths without the name part, and queryPathInfo() accepts such store paths (returning a ValidPathInfo object containing the full name).
2016-04-20	BinaryCacheStore: Insert new paths into the disk cache	Eelco Dolstra	1	-0/+4

2016-04-20	Cache path info lookups in SQLite	Eelco Dolstra	1	-2/+1
	This re-implements the binary cache database in C++, allowing it to be used by other Store backends, in particular the S3 backend.
2016-04-19	Move path info caching from BinaryCacheStore to Store	Eelco Dolstra	1	-80/+38
	Caching path info is generally useful. For instance, it speeds up "nix path-info -rS /run/current-system" (i.e. showing the closure sizes of all paths in the closure of the current system) from 5.6s to 0.15s. This also eliminates some APIs like Store::queryDeriver() and Store::queryReferences().
2016-04-15	BinaryCacheStore: Do negative caching of .narinfo lookups	Eelco Dolstra	1	-2/+10

2016-04-15	BinaryCacheStore::readFile(): Return a shared_ptr to a string	Eelco Dolstra	1	-7/+12
	This allows readFile() to indicate that a file doesn't exist, and might eliminate some large string copying.
2016-03-22	Don't overload dumpPath()	Eelco Dolstra	1	-3/+3

2016-03-21	Move signatures from NarInfo to ValidPathInfo	Eelco Dolstra	1	-2/+2
	This allows queryPathInfo() to return signatures.
2016-03-21	Add Store::dumpPath() method	Eelco Dolstra	1	-4/+11
	This allows applying nix-store --verify-path to binary cache stores: NIX_REMOTE=https://cache.nixos.org nix-store --verify-path /nix/store/s5c7...
2016-03-14	BinaryCacheStore::isValidPath(): Use .narinfo cache	Eelco Dolstra	1	-0/+9
	If a path is in the .narinfo cache, obviously it's valid.
2016-03-04	BinaryCacheStore: Remove publicKeyFile argument	Eelco Dolstra	1	-6/+3
	The public key can be derived from the secret key, so there's no need for the user to supply it separately.
2016-03-04	Eliminate some large string copying	Eelco Dolstra	1	-13/+13

2016-02-26	importPaths(): Optionally add NARs to binary cache accessor	Eelco Dolstra	1	-30/+36
	This enables an optimisation in hydra-queue-runner, preventing a download of a NAR it just uploaded to the cache when reading files like hydra-build-products.
2016-02-25	Add NAR / Store accessor abstraction	Eelco Dolstra	1	-4/+76
	This is primary to allow hydra-queue-runner to extract files like "nix-support/hydra-build-products" from NARs in binary caches.
2016-02-24	BinaryCacheStore: Implement addToStore()	Eelco Dolstra	1	-0/+50
	So now you can do $ NIX_REMOTE=file:///tmp/binary-cache nix-instantiate '<nixpkgs>' -A hello and lots of other operations.
2016-02-24	Show a proper error message for unimplemented binary cache operations	Eelco Dolstra	1	-0/+5

2016-02-24	Move BinaryCacheStore / LocalBinaryCacheStore from Hydra	Eelco Dolstra	1	-0/+292
	So you can now do: $ NIX_REMOTE=file:///tmp/binary-cache nix-store -qR /nix/store/...