depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2004-10-25	* Allow certain operations to succeed even if we don't have write	Eelco Dolstra	6	-10/+42
	permission to the Nix store or database. E.g., `nix-env -qa' will work, but `nix-env -qas' won't (the latter needs DB access). The option `--readonly-mode' forces this mode; otherwise, it's only activated when the database cannot be opened.
2004-09-22	* Make store objects created by substitutes read-only.	Eelco Dolstra	1	-0/+2

2004-09-12	* Fallback didn't work for subderivations of an unnormalised the main	Eelco Dolstra	1	-44/+7
	derivation, since NormalisationGoal would first run a NormalisationGoal on the subderivation (a no-op, since in a situation where we need fallback the successor is known), and then runs a RealisationGoal on the normal form, which then cannot do a fallback because it doesn't know the derivation expression for which it is a normal form. Tossed out the 2-phase normalisation/realisation in NormalisationGoal and SubstitutionGoal since it's no longer needed - a RealisationGoal will run a NormalisationGoal if necessary.
2004-09-09	* Remove write permission from store objects after they have been	Eelco Dolstra	1	-0/+4
	added to the store. Bug reported by Martin.
2004-09-09	* A very dirty hack to make setuid installations a bit nicer to use.	Eelco Dolstra	1	-2/+9
	Previously there was the problem that all files read by nix-env etc. should be reachable and readable by the Nix user. So for instance building a Nix expression in your home directory meant that the home directory should have at least g+x or o+x permission so that the Nix user could reach the Nix expression. Now we just switch back to the original user just prior to reading sources and the like. The places where this happens are somewhat arbitrary, however. Any scope that has a live SwitchToOriginalUser object in it is executed as the original user. * Back out r1385. setreuid() sets the saved uid to the new real/effective uid, which prevents us from switching back to the original uid. setresuid() doesn't have this problem (although the manpage has a bug: specifying -1 for the saved uid doesn't leave it unchanged; an explicit value must be specified).
2004-08-31	* Main the `substitutes-rev' table again, but now in a way that	Eelco Dolstra	2	-20/+36
	doesn't take \Theta(n^2) space/time complexity.
2004-08-31	* Quadruple the Berkeley DB locking limits to get rid of out of memory	Eelco Dolstra	1	-2/+21
	errors while running `nix-store --verify'.
2004-08-30	* Removed nrWaitees field. It was redundant with waitees.size() and	Eelco Dolstra	1	-24/+5
	could get out of sync if multiple input derivations mapped to the same closure expression (since waitees is a set).
2004-08-25	* `--min-age' flag in nix-store and nix-collect-garbage to only delete	Eelco Dolstra	2	-3/+20
	unreachable paths that haven't been used for N hours. For instance, `nix-collect-garbage --min-age 168' only deletes paths that haven't been accessed in the last week. This is useful for instance in the build farm where many derivations can be shared between consecutive builds, and we wouldn't want a garbage collect to throw them all away. We could of course register them as roots, but then we'd to unregister them at some point, which would be a pain to manage. The `--min-age' flag gives us a sort of MRU caching scheme. BUG: this really shouldn't be in gc.cc since that violates mechanism/policy separation.
2004-08-25	* Put the garbage collector in nix-store: operation `--gc',	Eelco Dolstra	5	-6/+110
	suboperations `--print-live', `--print-dead', and `--delete'. The roots are not determined by nix-store; they are read from standard input. This is to make it easy to customise what the roots are. The collector now no longer fails when store expressions are missing (which legally happens when using substitutes). It never tries to fetch paths through substitutes. TODO: acquire a global lock on the store while garbage collecting. * Removed `nix-store --delete'.
2004-08-18	* The default verbosity level of all Nix commands is now lvlInfo.	Eelco Dolstra	1	-1/+1
	* Builder output is written to standard error by default. * The option `-B' is gone. * The option `-Q' suppresses builder output. The result of this is that most Nix invocations shouldn't need any flags w.r.t. logging.
2004-08-11	* The predecessor of a successor need not be present. This in	Eelco Dolstra	1	-4/+6
	particular happens on distributed builds or when using push/pull.
2004-08-05	* Clean up the temporary directory for hook communication (and don't	Eelco Dolstra	1	-0/+1
	print out incorrect "build failed" messages).
2004-08-04	* Creating a file nix-support/no-scan in the output path of a	Eelco Dolstra	1	-2/+5
	derivation disables scanning for dependencies. Use at your own risk. This is a quick hack to speed up UML image generation (image are very big, say 1 GB). It would be better if the scanner were faster, and didn't read the whole file into memory.
2004-07-06	* Fixed format string error.	Eelco Dolstra	1	-1/+1

2004-07-01	* Don't go into a (sometimes infinite) loop calling the build hook.	Eelco Dolstra	1	-16/+24

2004-07-01	* Include some missing headers.	Eelco Dolstra	1	-0/+1

2004-06-29	* Write build logs to disk again.	Eelco Dolstra	1	-1/+29

2004-06-28	* In a realisation goal, check the result of the corresponding	Eelco Dolstra	1	-0/+6
	normalisation goal.
2004-06-28	* Added a switch `--fallback'. From the manual:	Eelco Dolstra	8	-48/+149
	Whenever Nix attempts to realise a derivation for which a closure is already known, but this closure cannot be realised, fall back on normalising the derivation. The most common scenario in which this is useful is when we have registered substitutes in order to perform binary distribution from, say, a network repository. If the repository is down, the realisation of the derivation will fail. When this option is specified, Nix will build the derivation instead. Thus, binary installation falls back on a source installation. This option is not the default since it is generally not desirable for a transient failure in obtaining the substitutes to lead to a full build from source (with the related consumption of resources).
2004-06-25	* A flag `--keep-going / -k' to keep building goals if one fails, as	Eelco Dolstra	3	-130/+157
	much as possible. (This is similar to GNU Make's `-k' flag.) * Refactoring to implement this: previously we just bombed out when a build failed, but now we have to clean up. In particular this means that goals must be freed quickly --- they shouldn't hang around until the worker exits. So the worker now maintains weak pointers in order not to prevent garbage collection. * Documented the `-k' and `-j' flags.
2004-06-25	* Don't throw an exception when a build fails. Just terminate the	Eelco Dolstra	1	-58/+214
	goal and allow the problem to be handled elsewhere (e.g., at top-level).
2004-06-24	* Obsolete.	Eelco Dolstra	1	-162/+0

2004-06-24	* Multiple and/or failing substitutes now work.	Eelco Dolstra	1	-12/+42

2004-06-22	* Arghhhhhh	Eelco Dolstra	1	-1/+1

2004-06-22	* Some more diagnostics changes.	Eelco Dolstra	1	-23/+39

2004-06-22	* Well, it's better than printf.	Eelco Dolstra	1	-1/+1

2004-06-22	* Started making Nix's diagnostic messages a bit more useful.	Eelco Dolstra	1	-10/+26

2004-06-22	* Put WEXITSTATUS stuff somewhere else.	Eelco Dolstra	2	-3/+3

2004-06-22	* Reduce gratuitous cut & pasting.	Eelco Dolstra	1	-68/+55

2004-06-22	* Wrapper class around pids.	Eelco Dolstra	2	-87/+37

2004-06-22	* Substitutes should occupy a build slot.	Eelco Dolstra	1	-1/+15

2004-06-22	* Refactoring.	Eelco Dolstra	2	-20/+7

2004-06-21	* Acquire a lock on the output path when running a substitute. Also	Eelco Dolstra	1	-0/+22
	delete obstructing invalid paths.
2004-06-21	* Ugh, nasty Heisenbug due to an uninitialiased variable. The bug	Eelco Dolstra	1	-0/+1
	only caused a crash if the program was not invoked with a high verbosity level.
2004-06-21	* Remove obstructing invalid store paths add[Text]ToStore().	Eelco Dolstra	1	-0/+6

2004-06-21	* Wrap calls to registerSubstitute() in a single transaction to	Eelco Dolstra	2	-10/+6
	improve throughput. * Don't build the `substitute-rev' table for now, since it caused Theta(N^2) time and log file consumption when adding N substitutes. Maybe we can do without it.
2004-06-21	* Disable calls to fsync() since Berkeley DB's DB_TXN_WRITE_NOSYNC	Eelco Dolstra	1	-0/+8
	flag doesn't seem to work as advertised.
2004-06-20	* Re-enable support for substitutes in the normaliser.	Eelco Dolstra	3	-83/+351
	* A better substitute mechanism. Instead of generating a store expression for each store path for which we have a substitute, we can have a single store expression that builds a generic program that is invoked to build the desired store path, which is passed as an argument. This means that operations like `nix-pull' only produce O(1) files instead of O(N) files in the store when registering N substitutes. (It consumes O(N) database storage, of course, but that's not a performance problem). * Added a test for the substitute mechanism. * `nix-store --substitute' reads the substitutes from standard input, instead of from the command line. This prevents us from running into the kernel's limit on command line length.
2004-06-20	* Refactoring.	Eelco Dolstra	1	-41/+2

2004-06-19	* Re-enable build hooks.	Eelco Dolstra	1	-72/+325

2004-06-18	* Big refactoring. Move to a much more explicitly state machine based	Eelco Dolstra	3	-764/+869
	approach. This makes it much easier to add extra complexity in the normaliser / realiser (e.g., build hooks, substitutes).
2004-06-15	* Refactoring.	Eelco Dolstra	1	-82/+18

2004-06-08	* Cleanup.	Eelco Dolstra	1	-10/+17

2004-05-18	* Drain the output of the build hook to show error messages. Ugly	Eelco Dolstra	1	-4/+26
	hack.
2004-05-18	* setpgrp() is not POSIX (and on Mac OS X it's different than on	Eelco Dolstra	1	-1/+1
	Linux), so use setpgid().
2004-05-14	* execl() requires a terminating 0.	Eelco Dolstra	1	-10/+21
	* When a fast build wakes up a goal, try to start that goal in the same iteration of the startBuild() loop of run(). Otherwise no job might be started until the next job terminates.
2004-05-13	* Distributed builds and load balancing now seem to work pretty well.	Eelco Dolstra	1	-24/+74
	(Though the `build-remote.pl' script has a gigantic race condition).
2004-05-13	* Load balancing. `build-remote.pl' will only execute up to a	Eelco Dolstra	1	-1/+1
	per-machine maximum number of parallel jobs on a remote machine.
2004-05-13	* The build hooks used to implement distributed builds can now be run	Eelco Dolstra	1	-134/+346
	in parallel. Hooks are more efficient: locks on output paths are only acquired when the hook says that it is willing to accept a build job. Hooks now work in two phases. First, they should first tell Nix whether they are willing to accept a job. Nix guarantuees that no two hooks will ever be in the first phase at the same time (this simplifies the implementation of hooks, since they don't have to perform locking (?)). Second, if they accept a job, they are then responsible for building it (on the remote system), and copying the result back. These can be run in parallel with other hooks and locally executed jobs. The implementation is a bit messy right now, though. * The directory `distributed' shows a (hacky) example of a hook that distributes build jobs over a set of machines listed in a configuration file.