depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2014-08-20	Use proper quotes everywhere	Eelco Dolstra	4	-15/+18

2014-08-13	Use $XDG_RUNTIME_DIR for temporary files	Eelco Dolstra	1	-1/+9

2014-07-24	nix-copy-closure: Drop --bzip2, --xz, --show-progress	Eelco Dolstra	1	-34/+7
	These are too difficult to implement via nix-store --serve. ‘--show-progress’ could be re-implemented fairly easily via a sink/source wrapper class.
2014-07-24	Fix NIX_SSHOPTS	Eelco Dolstra	2	-4/+8
	Closes #302.
2014-07-24	Remove obsolete SSH master connection code	Eelco Dolstra	1	-54/+1

2014-07-24	Refactor	Eelco Dolstra	2	-8/+21

2014-07-12	build-remote.pl: Don't keep a shell process around	Eelco Dolstra	1	-1/+2

2014-07-12	build-remote.pl: Fix build log	Eelco Dolstra	1	-2/+4

2014-07-11	build-remote.pl: Use ‘nix-store --serve’ on the remote side	Eelco Dolstra	5	-64/+128
	This makes things more efficient (we don't need to use an SSH master connection, and we only start a single remote process) and gets rid of locking issues (the remote nix-store process will keep inputs and outputs locked as long as they're needed). It also makes it more or less secure to connect directly to the root account on the build machine, using a forced command (e.g. ‘command="nix-store --serve --write"’). This bypasses the Nix daemon and is therefore more efficient. Also, don't call nix-store to import the output paths.
2014-07-11	Fix closure size display	Eelco Dolstra	1	-1/+1

2014-07-10	Fix use of sysread	Eelco Dolstra	1	-6/+18

2014-07-10	nix-copy-closure -s: Do substitutions via ‘nix-store --serve’	Eelco Dolstra	1	-8/+11
	This means we no longer need an SSH master connection, since we only execute a single command on the remote host.
2014-07-10	nix-copy-closure: Fix --dry-run	Eelco Dolstra	1	-8/+8

2014-07-10	nix-copy-closure: Restore compression and the progress viewer	Eelco Dolstra	1	-12/+40

2014-07-10	nix-copy-closure: Fix race condition	Eelco Dolstra	1	-3/+74
	There is a long-standing race condition when copying a closure to a remote machine, particularly affecting build-remote.pl: the client first asks the remote machine which paths it already has, then copies over the missing paths. If the garbage collector kicks in on the remote machine between the first and second step, the already-present paths may be deleted. The missing paths may then refer to deleted paths, causing nix-copy-closure to fail. The client now performs both steps using a single remote Nix call (using ‘nix-store --serve’), locking all paths in the closure while querying. I changed the --serve protocol a bit (getting rid of QueryCommand), so this breaks the SSH substituter from older versions. But it was marked experimental anyway. Fixes #141.
2014-02-01	Fix "make dist"	Eelco Dolstra	1	-3/+1

2014-02-01	Remove Automakefiles	Eelco Dolstra	1	-38/+0

2014-02-01	Update Makefile variable names	Eelco Dolstra	1	-3/+3

2014-01-30	Rename Makefile -> local.mk	Eelco Dolstra	1	-0/+0

2014-01-21	Fix build	Eelco Dolstra	1	-1/+2

2014-01-21	Ugly hack to fix building with clang	Eelco Dolstra	1	-0/+4

2014-01-21	Merge branch 'master' into make	Eelco Dolstra	5	-5/+84
	Conflicts: src/libexpr/eval.cc
2014-01-09	Update Makefiles	Eelco Dolstra	1	-1/+1

2014-01-08	Support cryptographically signed binary caches	Eelco Dolstra	4	-5/+82
	NAR info files in binary caches can now have a cryptographic signature that Nix will verify before using the corresponding NAR file. To create a private/public key pair for signing and verifying a binary cache, do: $ openssl genrsa -out ./cache-key.sec 2048 $ openssl rsa -in ./cache-key.sec -pubout > ./cache-key.pub You should also come up with a symbolic name for the key, such as "cache.example.org-1". This will be used by clients to look up the public key. (It's a good idea to number keys, in case you ever need to revoke/replace one.) To create a binary cache signed with the private key: $ nix-push --dest /path/to/binary-cache --key ./cache-key.sec --key-name cache.example.org-1 The public key (cache-key.pub) should be distributed to the clients. They should have a nix.conf should contain something like: signed-binary-caches = * binary-cache-public-key-cache.example.org-1 = /path/to/cache-key.pub If all works well, then if Nix fetches something from the signed binary cache, you will see a message like: *** Downloading ‘http://cache.example.org/nar/7dppcj5sc1nda7l54rjc0g5l1hamj09j-subversion-1.7.11’ (signed by ‘cache.example.org-1’) to ‘/nix/store/7dppcj5sc1nda7l54rjc0g5l1hamj09j-subversion-1.7.11’... On the other hand, if the signature is wrong, you get a message like NAR info file `http://cache.example.org/7dppcj5sc1nda7l54rjc0g5l1hamj09j.narinfo' has an invalid signature; ignoring Signatures are implemented as a single line appended to the NAR info file, which looks like this: Signature: 1;cache.example.org-1;HQ9Xzyanq9iV...muQ== Thus the signature has 3 fields: a version (currently "1"), the ID of key, and the base64-encoded signature of the SHA-256 hash of the contents of the NAR info file up to but not including the Signature line. Issue #75.
2013-12-20	perl: Call loadConfFile() in doInit to avoid screwing sqlite journal mode.	Petr Rockai	1	-0/+2
	If the database is opened through perl bindings (and even though nix.conf has use-sqlite-wal set to false), the database is automatically converted into WAL mode. This makes the next nix process to access the database convert it back to "truncate". If the database is still open at the time in wal mode by the perl program, this fails and crashes the nix doing the wal -> truncate conversion.
2013-12-02	Install bsdiff and bspatch in $(libexecdir)/nix	Eelco Dolstra	1	-1/+1

2013-11-25	Add a Makefile for the Perl stuff	Eelco Dolstra	2	-1/+42

2013-10-24	Fix segfault on Darwin	Eelco Dolstra	1	-0/+1
	Ever since SQLite in Nixpkgs was updated to 3.8.0.2, Nix has randomly segfaulted on Darwin: http://hydra.nixos.org/build/6175515 http://hydra.nixos.org/build/6611038 It turns out that this is because the binary cache substituter somehow ends up loading two versions of SQLite: the one in Nixpkgs and the other from /usr/lib/libsqlite3.dylib. It's not exactly clear why the latter is loaded, but it appears to be because WWW::Curl indirectly loads /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation, which in turn seems to load /usr/lib/libsqlite3.dylib. This leads to a segfault when Perl exits: #0 0x00000001010375f4 in sqlite3_finalize () #1 0x000000010125806e in sqlite_st_destroy () #2 0x000000010124bc30 in XS_DBD__SQLite__st_DESTROY () #3 0x00000001001c8155 in XS_DBI_dispatch () ... #14 0x0000000100023224 in perl_destruct () #15 0x0000000100000d6a in main () ... The workaround is to explicitly load DBD::SQLite before WWW::Curl.
2013-09-06	Don't apply the CPU affinity hack to nix-shell (and other Perl programs)	Eelco Dolstra	1	-0/+1
	As discovered by Todd Veldhuizen, the shell started by nix-shell has its affinity set to a single CPU. This is because nix-shell connects to the Nix daemon, which causes the affinity hack to be applied. So we turn this off for Perl programs.
2013-06-20	Don't keep "disabled" substituters running	Eelco Dolstra	1	-1/+4
	For instance, it's pointless to keep copy-from-other-stores running if there are no other stores, or download-using-manifests if there are no manifests. This also speeds things up because we don't send queries to those substituters.
2013-05-10	build-remote.pl: Properly close the SSH connection between attempts	Eelco Dolstra	1	-0/+1

2013-05-03	Fixing the pv position regarding compression	Lluís Batlle i Rossell	1	-1/+1
	Problem noticed by niksnut.
2013-05-03	Adding ETA support to the --show-progress in nix-copy-closure	Lluís Batlle i Rossell	1	-4/+8
	Based on https://github.com/NixOS/nix/pull/6 from shlevy
2013-03-08	Revert "Prevent config.h from being clobbered"	Eelco Dolstra	1	-9/+12
	This reverts commit 28bba8c44f484eae38e8a15dcec73cfa999156f6.
2013-03-08	Fix annoying Perl 5.16 warnings	Eelco Dolstra	1	-17/+17
	I.e. Subroutine Nix::Store::isValidPath redefined at /nix/store/clfzsf6gi7qh5i9c0vks1ifjam47rijn-perl-5.16.2/lib/perl5/5.16.2/XSLoader.pm line 92. and so on.
2013-03-07	Prevent config.h from being clobbered	Eelco Dolstra	1	-12/+9

2013-02-05	Nix::Store::derivationFromPath: Return derivation outputs	Eelco Dolstra	1	-9/+12

2012-12-20	Give a better error message if writeFile fails due to permission issues	Eelco Dolstra	1	-2/+2

2012-11-23	nix-copy-closure: Add flag ‘--use-substitutes’	Eelco Dolstra	1	-1/+8

2012-10-17	nix-push: Only generate and copy a NAR if it doesn't already exist	Eelco Dolstra	2	-1/+58
	This prevents unnecessary and slow rebuilds of NARs that already exist in the binary cache.
2012-10-10	Out-of-tree building of perl modules.	Mats Erik Andersson	1	-0/+1

2012-09-19	Support xz compression in the download-using-manifests substituter	Eelco Dolstra	1	-6/+12

2012-09-13	Delete manifests in "nix-channel --remove" or when a binary cache is available	Eelco Dolstra	1	-21/+39

2012-08-27	Drop dependency on List::MoreUtils	Eelco Dolstra	1	-0/+11

2012-08-27	Add missing file	Eelco Dolstra	1	-0/+8

2012-07-30	Refactor settings processing	Eelco Dolstra	1	-1/+1
	Put all Nix configuration flags in a Settings object.
2012-07-30	Do some validation of URLs	Eelco Dolstra	1	-1/+1

2012-07-30	Pass configuration settings to the substituters	Eelco Dolstra	1	-1/+9
	Previously substituters could read nix.conf themselves, but this didn't take --option flags into account.
2012-07-18	Merge branch 'master' into no-manifests	Eelco Dolstra	2	-0/+12

2012-07-17	Add function queryPathFromHashPart()	Eelco Dolstra	2	-0/+12
	To implement binary caches efficiently, Hydra needs to be able to map the hash part of a store path (e.g. "gbg...zr7") to the full store path (e.g. "/nix/store/gbg...kzr7-subversion-1.7.5"). (The binary cache mechanism uses hash parts as a key for looking up store paths to ensure privacy.) However, doing a search in the Nix store for /nix/store/<hash>* is expensive since it requires reading the entire directory. queryPathFromHashPart() prevents this by doing a cheap database lookup.