depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2014-07-25	nix-daemon: Pass on the user's $SSH_AUTH_SOCK to the SSH substituter	Eelco Dolstra	1	-0/+8

2014-07-25	Change the default for use-ssh-substituter to ‘true’	Eelco Dolstra	1	-2/+2
	Now you only have to pass ‘--option ssh-substituter-hosts nix-ssh@bla’ to enable SSH substitution.
2014-07-19	Revert old useBuildHook behaviour	Eelco Dolstra	1	-1/+1

2014-07-17	nix-daemon: Add trusted-users and allowed-users options	Eelco Dolstra	1	-0/+4
	‘trusted-users’ is a list of users and groups that have elevated rights, such as the ability to specify binary caches. It defaults to ‘root’. A typical value would be ‘@wheel’ to specify all users in the wheel group. ‘allowed-users’ is a list of users and groups that are allowed to connect to the daemon. It defaults to ‘*’. A typical value would be ‘@users’ to specify the ‘users’ group.
2014-07-16	Handle case collisions on case-insensitive systems	Eelco Dolstra	1	-0/+2
	When running NixOps under Mac OS X, we need to be able to import store paths built on Linux into the local Nix store. However, HFS+ is usually case-insensitive, so if there are directories with file names that differ only in case, then importing will fail. The solution is to add a suffix ("~nix~case~hack~<integer>") to colliding files. For instance, if we have a directory containing xt_CONNMARK.h and xt_connmark.h, then the latter will be renamed to "xt_connmark.h~nix~case~hack~1". If a store path is dumped as a NAR, the suffixes are removed. Thus, importing and exporting via a case-insensitive Nix store is round-tripping. So when NixOps calls nix-copy-closure to copy the path to a Linux machine, you get the original file names back. Closes #119.
2014-07-11	Allow $NIX_BUILD_HOOK to be relative to Nix libexec directory	Eelco Dolstra	1	-1/+1

2014-06-27	allow-arbitrary-code-during-evaluation -> ↵	Eelco Dolstra	1	-1/+1
	allow-unsafe-native-code-during-evaluation
2014-06-24	Only add the importNative primop if the ↵	Shea Levy	1	-0/+2
	allow-arbitrary-code-during-evaluation option is true (default false)
2014-05-21	nix-store -l: Fetch build logs from the Internet	Eelco Dolstra	1	-0/+1
	If a build log is not available locally, then ‘nix-store -l’ will now try to download it from the servers listed in the ‘log-servers’ option in nix.conf. For instance, if you have: log-servers = http://hydra.nixos.org/log then it will try to get logs from http://hydra.nixos.org/log/<base name of the store path>. So you can do things like: $ nix-store -l $(which xterm) and get a log even if xterm wasn't built locally.
2014-05-02	Set build-max-jobs to the number of available cores by default	Eelco Dolstra	1	-0/+5
	More zero configuration.
2014-05-02	When running as root, use build users by default	Eelco Dolstra	1	-0/+1
	This removes the need to have a nix.conf, and prevents people from accidentally running Nix builds as root.
2014-02-27	Set up a private /dev/pts in the chroot	Eelco Dolstra	1	-1/+0

2014-02-27	Set up a minimal /dev in chroots	Eelco Dolstra	1	-1/+0
	Not bind-mounting the /dev from the host also solves the problem with /dev/shm being a symlink to something not in the chroot.
2014-02-26	Only start download-via-ssh if it's enabled	Eelco Dolstra	1	-12/+14

2014-02-26	Add use-ssh-substituter setting.	Shea Levy	1	-0/+2
	It defaults to false and can be overridden by RemoteStore. Untested currently, just quickly put this together
2014-02-14	Minor style fixes	Eelco Dolstra	1	-1/+1

2014-02-10	Pass in params by const ref	Shea Levy	1	-1/+1
	Signed-off-by: Shea Levy <shea@shealevy.com>
2014-02-08	Add download-via-ssh substituter	Shea Levy	1	-0/+20
	This substituter connects to a remote host, runs nix-store --serve there, and then forwards substituter commands on to the remote host and sends their results to the calling program. The ssh-substituter-hosts option can be specified as a list of hosts to try. This is an initial implementation and, while it works, it has some limitations: * Only the first host is used * There is no caching of query results (all queries are sent to the remote machine) * There is no informative output (such as progress bars) * Some failure modes may cause unhelpful error messages * There is no concept of trusted-ssh-substituter-hosts Signed-off-by: Shea Levy <shea@shealevy.com>
2013-11-22	Drop the dependency on Automake	Eelco Dolstra	1	-1/+1

2013-11-12	Make function calls show up in stack traces again	Eelco Dolstra	1	-0/+1
	Note that adding --show-trace prevents functions calls from being tail-recursive, so an expression that evaluates without --show-trace may fail with a stack overflow if --show-trace is given.
2013-09-06	Don't apply the CPU affinity hack to nix-shell (and other Perl programs)	Eelco Dolstra	1	-0/+1
	As discovered by Todd Veldhuizen, the shell started by nix-shell has its affinity set to a single CPU. This is because nix-shell connects to the Nix daemon, which causes the affinity hack to be applied. So we turn this off for Perl programs.
2013-09-02	Add an option to limit the log output of builders	Eelco Dolstra	1	-0/+2
	This is mostly useful for Hydra to deal with builders that get stuck in an infinite loop writing data to stdout/stderr.
2013-06-20	Disable the copy-from-other-stores substituter	Eelco Dolstra	1	-0/+2
	This substituter basically cannot work reliably since we switched to SQLite, since SQLite databases may need write access to open them even just for reading (and in WAL mode they always do).
2013-03-08	Revert "Prevent config.h from being clobbered"	Eelco Dolstra	1	-0/+9
	This reverts commit 28bba8c44f484eae38e8a15dcec73cfa999156f6.
2013-03-07	Prevent config.h from being clobbered	Eelco Dolstra	1	-9/+0

2013-02-19	Add `Settings::nixDaemonSocketFile'.	Ludovic Courtès	1	-0/+9

2012-12-29	Allow mounting a path in a different location in the chroot	Eelco Dolstra	1	-1/+1
	Fixes #24.
2012-11-27	Add builtin constants ‘langVersion’ and ‘nixVersion’	Eelco Dolstra	1	-0/+3
	The integer constant ‘langVersion’ denotes the current language version. It gets increased every time a language feature is added/changed/removed. It's currently 1. The string constant ‘nixVersion’ contains the current Nix version, e.g. "1.2pre2980_9de6bc5".
2012-11-09	Don't start copy-from-other-stores if $NIX_OTHER_STORES is unset	Eelco Dolstra	1	-1/+2
	Slight optimisation.
2012-09-19	Templatise tokenizeString()	Eelco Dolstra	1	-14/+6

2012-09-13	Disable auto store optimisation for now	Eelco Dolstra	1	-1/+1
	I've seen operations like "nix-store --import" take much longer on one system. So default to off until I've investigated this a bit further.
2012-07-31	Prevent an injection attack in passing untrusted options to substituters	Eelco Dolstra	1	-0/+4

2012-07-31	Pass all --option flags to the daemon	Eelco Dolstra	1	-0/+7

2012-07-31	Add an option ‘build-fallback’ (equivalent to the --fallback flag)	Eelco Dolstra	1	-1/+2

2012-07-30	Refactor settings processing	Eelco Dolstra	1	-96/+105
	Put all Nix configuration flags in a Settings object.
2012-07-30	Pass configuration settings to the substituters	Eelco Dolstra	1	-5/+18
	Previously substituters could read nix.conf themselves, but this didn't take --option flags into account.
2012-07-11	Update the other substituters	Eelco Dolstra	1	-2/+2

2012-07-06	download-from-binary-cache: parallelise fetching of NAR info files	Eelco Dolstra	1	-2/+3
	Getting substitute information using the binary cache substituter has non-trivial latency overhead. A package or NixOS system configuration can have hundreds of dependencies, and in the worst case (when the local info cache is empty) we have to do a separate HTTP request for each of these. If the ping time to the server is t, getting N info files will take tN seconds; e.g., with a ping time of 0.1s to nixos.org, sequentially downloading 1000 info files (a typical NixOS config) will take at least 100 seconds. To fix this problem, the binary cache substituter can now perform requests in parallel. This required changing the substituter interface to support a function querySubstitutablePathInfos() that queries multiple paths at the same time, and rewriting queryMissing() to take advantage of parallelism. (Due to local caching, parallelising queryMissing() is sufficient for most use cases, since it's almost always called before building a derivation and thus fills the local info cache.) For example, parallelism speeds up querying all 1056 paths in a particular NixOS system configuration from 116s to 2.6s. It works so well because the eccentricity of the top-level derivation in the dependency graph is only 9. So we only need 10 round-trips (when using an unlimited number of parallel connections) to get everything. Currently we do a maximum of 150 parallel connections to the server. Thus it's important that the binary cache server (e.g. nixos.org) has a high connection limit. Alternatively we could use HTTP pipelining, but WWW::Curl doesn't support it and libcurl has a hard-coded limit of 5 requests per pipeline.
2011-11-22	* Move initialisation of variables like nixConfDir from libmain to	Eelco Dolstra	1	-0/+30
	libstore so that the Perl bindings can use it as well. It's vital that the Perl bindings use the configuration file, because otherwise nix-copy-closure will fail with a ‘database locked’ message if the value of ‘use-sqlite-wal’ is changed from the default.
2011-06-30	Add support for the `build-timeout' and `--timeout' options.	Ludovic Courtès	1	-0/+1

2010-08-30	* When using the build hook, distinguish between the stderr of the	Eelco Dolstra	1	-1/+1
	hook script proper, and the stdout/stderr of the builder. Only the latter should be saved in /nix/var/log/nix/drvs. * Allow the verbosity to be set through an option. * Added a flag --quiet to lower the verbosity level.
2010-06-23	Added support for passing an (impure) NIX_BUILD_CORES variable to build ↵	Peter Simons	1	-0/+1
	expressions. This patch adds the configuration file variable "build-cores" and the command line argument "--cores". These settings specify the number of CPU cores to utilize for parallel building within a job, i.e. by passing an appropriate "-j" flag to GNU Make. The default value is 1, which means that parallel building is disabled. If the number of build cores is specified as 0 (synonymously: "guess" or "auto"), then the actual value is supposed to be auto-detected by builders at run-time, i.e by calling the nproc(1) utility from coreutils. The environment variable $NIX_BUILD_CORES is available to builders, but the contents of that variable does not influence the hash that goes into the $out store path, i.e. the number of build cores to be utilized can be changed at will without requiring any re-builds.
2009-03-23	* No longer block while waiting for a lock on a store path. Instead	Eelco Dolstra	1	-1/+1
	poll for it (i.e. if we can't acquire the lock, then let the main select() loop wait for at most a few seconds and then try again). This improves parallelism: if two nix-store processes are both trying to build a path at the same time, the second one shouldn't block; it should first see if it can build other goals. Also, it prevents the deadlocks that have been occuring in Hydra lately, where a process waits for a lock held by another process that's waiting for a lock held by the first. The downside is that polling isn't really elegant, but POSIX doesn't provide a way to wait for locks in a select() loop. The only solution would be to spawn a thread for each lock to do a blocking fcntl() and then signal the main thread, but that would require pthreads.
2009-02-27	* Allow options from the Nix config file to be overriden from the	Eelco Dolstra	1	-0/+12
	command line (e.g. "--option build-use-chroot true").
2008-12-11	* Revert r13150: now that we use private namespaces for the chroot, we	Eelco Dolstra	1	-1/+0
	don't have to put the chroot in /nix/var/nix/chroots anymore. They're back in /tmp now.
2008-11-20	* Nix daemon: reload the configuration file after forking (NIX-100).	Eelco Dolstra	1	-0/+7

2008-11-12	* Some somewhat ad hoc mechanism to allow the build farm to monitor	Eelco Dolstra	1	-0/+1
	build progress.
2008-10-29	* Put the chroots under /nix/var/nix/chroots to reduce the risk of	Eelco Dolstra	1	-0/+1
	disasters involving `rm -rf' on bind mounts. Will try the definitive fix (per-process mounts, apparently possible via the CLONE_NEWNS flag in clone()) some other time.
2007-11-16	* Flag `--no-build-hook' to disable distributed builds.	Eelco Dolstra	1	-0/+1
	* queryDeriver in daemon mode: don't barf if the other side returns an empty string (which means there is no deriver).
2007-08-12	* Get rid of the substitutes database table (NIX-47). Instead, if we	Eelco Dolstra	1	-0/+1
	need any info on substitutable paths, we just call the substituters (such as download-using-manifests.pl) directly. This means that it's no longer necessary for nix-pull to register substitutes or for nix-channel to clear them, which makes those operations much faster (NIX-95). Also, we don't have to worry about keeping nix-pull manifests (in /nix/var/nix/manifests) and the database in sync with each other. The downside is that there is some overhead in calling an external program to get the substitutes info. For instance, "nix-env -qas" takes a bit longer. Abolishing the substitutes table also makes the logic in local-store.cc simpler, as we don't need to store info for invalid paths. On the downside, you cannot do things like "nix-store -qR" on a substitutable but invalid path (but nobody did that anyway). * Never catch interrupts (the Interrupted exception).