depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2014-08-01	Remove ugly hack for detecting build environment setup errors	Eelco Dolstra	1	-13/+10

2014-08-01	Call commonChildInit() before doing chroot init	Eelco Dolstra	1	-4/+6
	This ensures that daemon clients see error messages from the chroot setup.
2014-08-01	findRoots(): Prevent a call to lstat()	Eelco Dolstra	1	-9/+14
	This means that getting the roots from /nix/var/nix/.../hydra-roots doesn't need any I/O other than reading the directory.
2014-08-01	Make readDirectory() return inode / file type	Eelco Dolstra	2	-19/+15

2014-08-01	Allow regular files as GC roots	Eelco Dolstra	1	-0/+6
	If a root is a regular file, then its name must denote a store path. For instance, the existence of the file /nix/var/nix/gcroots/per-user/eelco/hydra-roots/wzc3cy1wwwd6d0dgxpa77ijr1yp50s6v-libxml2-2.7.7 would cause /nix/store/wzc3cy1wwwd6d0dgxpa77ijr1yp50s6v-libxml2-2.7.7 to be a root. This is useful because it involves less I/O (no need for a readlink() call) and takes up less disk space (the symlink target typically takes up a full disk block, while directory entries are packed more efficiently). This is particularly important for hydra.nixos.org, which has hundreds of thousands of roots, and where reading the roots can take 25 minutes.
2014-07-31	Restore default SIGPIPE handler before invoking ‘man’	Eelco Dolstra	1	-12/+0
	Fixes NixOS/nixpkgs#3410.
2014-07-25	nix-daemon: Pass on the user's $SSH_AUTH_SOCK to the SSH substituter	Eelco Dolstra	3	-0/+12

2014-07-25	Change the default for use-ssh-substituter to ‘true’	Eelco Dolstra	1	-2/+2
	Now you only have to pass ‘--option ssh-substituter-hosts nix-ssh@bla’ to enable SSH substitution.
2014-07-24	Remove some dead code	Eelco Dolstra	1	-1/+0

2014-07-23	Remove dead code	Eelco Dolstra	2	-3/+0

2014-07-19	Revert old useBuildHook behaviour	Eelco Dolstra	2	-2/+2

2014-07-17	nix-daemon: Add trusted-users and allowed-users options	Eelco Dolstra	2	-0/+13
	‘trusted-users’ is a list of users and groups that have elevated rights, such as the ability to specify binary caches. It defaults to ‘root’. A typical value would be ‘@wheel’ to specify all users in the wheel group. ‘allowed-users’ is a list of users and groups that are allowed to connect to the daemon. It defaults to ‘*’. A typical value would be ‘@users’ to specify the ‘users’ group.
2014-07-16	Handle case collisions on case-insensitive systems	Eelco Dolstra	1	-0/+2
	When running NixOps under Mac OS X, we need to be able to import store paths built on Linux into the local Nix store. However, HFS+ is usually case-insensitive, so if there are directories with file names that differ only in case, then importing will fail. The solution is to add a suffix ("~nix~case~hack~<integer>") to colliding files. For instance, if we have a directory containing xt_CONNMARK.h and xt_connmark.h, then the latter will be renamed to "xt_connmark.h~nix~case~hack~1". If a store path is dumped as a NAR, the suffixes are removed. Thus, importing and exporting via a case-insensitive Nix store is round-tripping. So when NixOps calls nix-copy-closure to copy the path to a Linux machine, you get the original file names back. Closes #119.
2014-07-14	build-remote.pl: Fix building multiple output derivations	Eelco Dolstra	1	-1/+0
	We were importing paths without sorting them topologically, leading to "path is not valid" errors. See e.g. http://hydra.nixos.org/build/12451761
2014-07-11	build-remote.pl: Use ‘nix-store --serve’ on the remote side	Eelco Dolstra	1	-0/+1
	This makes things more efficient (we don't need to use an SSH master connection, and we only start a single remote process) and gets rid of locking issues (the remote nix-store process will keep inputs and outputs locked as long as they're needed). It also makes it more or less secure to connect directly to the root account on the build machine, using a forced command (e.g. ‘command="nix-store --serve --write"’). This bypasses the Nix daemon and is therefore more efficient. Also, don't call nix-store to import the output paths.
2014-07-11	Allow $NIX_BUILD_HOOK to be relative to Nix libexec directory	Eelco Dolstra	2	-3/+5

2014-07-10	Replace message "importing path <...>" with "exporting path <...>"	Eelco Dolstra	1	-2/+2
	This causes nix-copy-closure to show what it's doing before rather than after.
2014-07-10	Remove tabs	Eelco Dolstra	1	-3/+3

2014-07-10	Refactoring: Move all fork handling into a higher-order function	Eelco Dolstra	2	-75/+33
	C++11 lambdas ftw.
2014-07-10	Remove maybeVfork	Eelco Dolstra	2	-3/+3

2014-06-27	allow-arbitrary-code-during-evaluation -> ↵	Eelco Dolstra	1	-1/+1
	allow-unsafe-native-code-during-evaluation
2014-06-24	Only add the importNative primop if the ↵	Shea Levy	2	-0/+5
	allow-arbitrary-code-during-evaluation option is true (default false)
2014-06-10	Report daemon OOM better	Eelco Dolstra	1	-5/+17
	When copying a large path causes the daemon to run out of memory, you now get: error: Nix daemon out of memory instead of: error: writing to file: Broken pipe
2014-06-10	Print a warning when loading a large path into memory	Eelco Dolstra	1	-0/+3
	I.e. if you have a derivation with src = ./huge-directory; you'll get a warning that this is not a good idea.
2014-05-26	Use std::unordered_set	Eelco Dolstra	2	-12/+3

2014-05-21	nix-store -l: Fetch build logs from the Internet	Eelco Dolstra	2	-0/+4
	If a build log is not available locally, then ‘nix-store -l’ will now try to download it from the servers listed in the ‘log-servers’ option in nix.conf. For instance, if you have: log-servers = http://hydra.nixos.org/log then it will try to get logs from http://hydra.nixos.org/log/<base name of the store path>. So you can do things like: $ nix-store -l $(which xterm) and get a log even if xterm wasn't built locally.
2014-05-15	lvlInfo -> lvlTalkative	Eelco Dolstra	1	-1/+1

2014-05-15	nix-store --optimise: Remove bogus statistics	Eelco Dolstra	2	-10/+7

2014-05-15	Remove tab	Eelco Dolstra	1	-2/+2

2014-05-15	Shortcut store files before lstat	Wout Mertens	2	-9/+37
	readdir() already returns the inode numbers, so we don't need to call lstat to know if a file was already linked or not.
2014-05-14	Use the inodes given by readdir directly	Wout Mertens	2	-21/+25

2014-05-13	Preload linked hashes to speed up lookups	Wout Mertens	2	-10/+41
	By preloading all inodes in the /nix/store/.links directory, we can quickly determine of a hardlinked file was already linked to the hashed links. This is tolerant of removing the .links directory, it will simply recalculate all hashes in the store.
2014-05-10	Shortcut already-hardlinked files	wmertens	1	-1/+10
	If an inode in the Nix store has more than 1 link, it probably means that it was linked into .links/ by us. If so, skip. There's a possibility that something else hardlinked the file, so it would be nice to be able to override this. Also, by looking at the number of hardlinks for each of the files in .links/, you can get deduplication numbers and space savings.
2014-05-02	Set up directories and permissions for multi-user install automatically	Eelco Dolstra	1	-1/+28
	This automatically creates /nix/var/nix/profiles/per-user and sets the permissions/ownership on /nix/store to 1775 and root:nixbld.
2014-05-02	Set build-max-jobs to the number of available cores by default	Eelco Dolstra	1	-0/+5
	More zero configuration.
2014-05-02	When running as root, use build users by default	Eelco Dolstra	1	-0/+1
	This removes the need to have a nix.conf, and prevents people from accidentally running Nix builds as root.
2014-04-08	If a .drv cannot be parsed, show its path	Eelco Dolstra	4	-8/+18
	Otherwise you just get ‘expected string `Derive(['’ which isn't very helpful.
2014-04-03	Fix compile errors on Illumos	Danny Wilson	2	-0/+5

2014-04-03	Make sure /dev/pts/ptmx is world-writable	Ludovic Courtès	1	-0/+4
	While running Python 3’s test suite, we noticed that on some systems /dev/pts/ptmx is created with permissions 0 (that’s the case with my Nixpkgs-originating 3.0.43 kernel, but someone with a Debian-originating 3.10-3 reported not having this problem.) There’s still the problem that people without CONFIG_DEVPTS_MULTIPLE_INSTANCES=y are screwed (as noted in build.cc), but I don’t see how we could work around it.
2014-03-30	boost::shared_ptr -> std::shared_ptr	Eelco Dolstra	4	-31/+34

2014-03-29	Fix potential segfault in waitForInput()	Eelco Dolstra	1	-3/+5
	Since the addition of build-max-log-size, a call to handleChildOutput() can result in cancellation of a goal. This invalidated the "j" iterator in the waitForInput() loop, even though it was still used afterwards. Likewise for the maxSilentTime handling. Probably fixes #231. At least it gets rid of the valgrind warnings.
2014-03-29	restoreSIGPIPE(): Fill in sa_mask	Eelco Dolstra	1	-0/+1
	Issue #231.
2014-03-21	Make /dev/kvm optional	Ludovic Courtès	1	-1/+4
	The daemon now creates /dev deterministically (thanks!). However, it expects /dev/kvm to be present. The patch below restricts that requirement (1) to Linux-based systems, and (2) to systems where /dev/kvm already exists. I’m not sure about the way to handle (2). We could special-case /dev/kvm and create it (instead of bind-mounting it) in the chroot, so it’s always available; however, it wouldn’t help much since most likely, if /dev/kvm missing, then KVM support is missing.
2014-02-27	Set up a private /dev/pts in the chroot	Eelco Dolstra	2	-2/+14

2014-02-27	Set up a minimal /dev in chroots	Eelco Dolstra	4	-13/+28
	Not bind-mounting the /dev from the host also solves the problem with /dev/shm being a symlink to something not in the chroot.
2014-02-27	Fix deadlock in SubstitutionGoal	Eelco Dolstra	1	-0/+1
	We were relying on SubstitutionGoal's destructor releasing the lock, but if a goal is a top-level goal, the destructor won't run in a timely manner since its reference count won't drop to zero. So release it explicitly. Fixes #178.
2014-02-26	Only start download-via-ssh if it's enabled	Eelco Dolstra	1	-12/+14

2014-02-26	Add use-ssh-substituter setting.	Shea Levy	2	-0/+5
	It defaults to false and can be overridden by RemoteStore. Untested currently, just quickly put this together
2014-02-18	Slight simplification	Eelco Dolstra	1	-17/+10

2014-02-18	Add a flag ‘--check’ to verify build determinism	Eelco Dolstra	5	-49/+86
	The flag ‘--check’ to ‘nix-store -r’ or ‘nix-build’ will cause Nix to redo the build of a derivation whose output paths are already valid. If the new output differs from the original output, an error is printed. This makes it easier to test if a build is deterministic. (Obviously this cannot catch all sources of non-determinism, but it catches the most common one, namely the current time.) For example: $ nix-build '<nixpkgs>' -A patchelf ... $ nix-build '<nixpkgs>' -A patchelf --check error: derivation `/nix/store/1ipvxsdnbhl1rw6siz6x92s7sc8nwkkb-patchelf-0.6' may not be deterministic: hash mismatch in output `/nix/store/4pc1dmw5xkwmc6q3gdc9i5nbjl4dkjpp-patchelf-0.6.drv' The --check build fails if not all outputs are valid. Thus the first call to nix-build is necessary to ensure that all outputs are valid. The current outputs are left untouched: the new outputs are either put in a chroot or diverted to a different location in the store using hash rewriting.