depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2005-02-01	* Remove debug code.	Eelco Dolstra	1	-2/+2

2005-02-01	* Make check fixes.	Eelco Dolstra	5	-15/+13

2005-02-01	* Move root finding from `nix-collect-garbage' to `nix-store --gc'.	Eelco Dolstra	4	-112/+76
	This was necessary becase root finding must be done after acquisition of the global GC lock. This makes `nix-collect-garbage' obsolete; it is now just a wrapper around `nix-store --gc'. * Automatically remove stale GC roots (i.e., indirect GC roots that point to non-existent paths).
2005-02-01	* nix-build: use an indirection scheme to make it easier for users to	Eelco Dolstra	7	-49/+100
	get rid of GC roots. Nix-build places a symlink `result' in the current directory. Previously, removing that symlink would not remove the store path being linked to as a GC root. Now, the GC root created by nix-build is actually a symlink in `/nix/var/nix/gcroots/auto' to `result'. So if that symlink is removed the GC root automatically becomes invalid (since it can no longer be resolved). The root itself is not automatically removed - the garbage collector should delete dangling roots.
2005-02-01	* nix-store, nix-instantiate: added an option `--add-root' to	Eelco Dolstra	11	-17/+165
	immediately add the result as a permanent GC root. This is the only way to prevent a race with the garbage collector. For instance, the old style ln -s $(nix-store -r $(nix-instantiate foo.nix)) \ /nix/var/nix/gcroots/result has two time windows in which the garbage collector can interfere (by GC'ing the derivation and the output, respectively). On the other hand, nix-store --add-root /nix/var/nix/gcroots/result -r \ $(nix-instantiate --add-root /nix/var/nix/gcroots/drv \ foo.nix) is safe. * nix-build: use `--add-root' to prevent GC races.
2005-02-01	* Get rid of hardcoded paths.	Eelco Dolstra	1	-7/+7

2005-02-01	* Add missing files to dist.	Eelco Dolstra	4	-5/+14
	* Fix GC and substitute bugs related to self-references. Add a regression test.
2005-01-31	* Acquire a global GC lock to prevent new temporary root files from	Eelco Dolstra	3	-19/+36
	being created after the garbage collector has read the temproots directory. This blocks the creation of new processes, but the garbage collector could periodically release the GC lock to allow them to run.
2005-01-31	* Add a test for a more subtle race: a process starting after the	Eelco Dolstra	5	-20/+85
	temporary root files have been read but creating outputs before the store directory has been read.
2005-01-31	* Automatically remove temporary root files.	Eelco Dolstra	3	-1/+30

2005-01-31	* Topologically sort paths under the references relation to ensure	Eelco Dolstra	3	-39/+84
	that they are deleted in an order that maintains the closure invariant. * Presence of a path in a temporary roots file does not imply that all paths in its closure are also present, so add the closure.
2005-01-31	* Don't delete active lock files.	Eelco Dolstra	5	-9/+39

2005-01-31	* Start of concurrent garbage collection. Processes write temporary	Eelco Dolstra	11	-107/+192
	roots to a per-process temporary file in /nix/var/nix/temproots while holding a write lock on that file. The garbage collector acquires read locks on all those files, thus blocking further progress in other Nix processes, and reads the sets of temporary roots.
2005-01-28	* Add a test to check whether concurrent garbage collection (i.e.,	Eelco Dolstra	4	-1/+56
	running the collector while builds are in progress) works correctly. The test currently fails.
2005-01-28	* Use NIX_STORE environment variable to locate the store (in addition	Eelco Dolstra	1	-1/+1
	to NIX_STORE_DIR) so that Nix invocations in builders in `make check' work correctly if the store doesn't exist.
2005-01-28	* Another horrible `make check' hack.	Eelco Dolstra	1	-2/+3

2005-01-28	* Only invalidate paths when they are in fact valid.	Eelco Dolstra	1	-1/+2

2005-01-27	* Set execute permission.	Eelco Dolstra	1	-1/+3

2005-01-27	* Missing dependency; only a problem when building from Subversion.	Eelco Dolstra	1	-1/+1

2005-01-27	* Add missing substitutes files to dist.	Eelco Dolstra	4	-20/+25
	* Add a garbage collector test.
2005-01-27	* Fix deadlock.	Eelco Dolstra	1	-1/+1

2005-01-27	* Update referers mappings when updating/clearing the references	Eelco Dolstra	1	-7/+27
	mapping. * Do things in the right order in invalidatePath().
2005-01-27	* Remove deleted files from EXTRA_DIST (again).	Eelco Dolstra	1	-3/+1

2005-01-27	* Fix and simplify the garbage collector (it's still not concurrent,	Eelco Dolstra	10	-109/+124
	though). In particular it's now much easier to register a GC root. Just place a symlink to whatever store path it is that you want to keep in /nix/var/nix/gcroots.
2005-01-27	* Make lock removal safe by signalling to blocked processes that the	Eelco Dolstra	4	-24/+55
	lock they are waiting on has become stale (we do this by writing a meaningless token to the unlinked file).
2005-01-25	* Maintain the references/referers relation also for derivations.	Eelco Dolstra	8	-82/+84
	This simplifies garbage collection and `nix-store --query --requisites' since we no longer need to treat derivations specially. * Better maintaining of the invariants, e.g., setReferences() can only be called on a valid/substitutable path.
2005-01-25	* Simplification: registerSubstitutes -> registerSubstitute. We no	Eelco Dolstra	4	-24/+12
	longer need the former since there we no longer have the substitutes-rev table (which triggered a O(n^2) cost in updating them).
2005-01-25	* Remove removed files from EXTRA_DIST.	Eelco Dolstra	1	-2/+2

2005-01-25	* Re-enable all tests.	Eelco Dolstra	4	-8/+6

2005-01-25	* Really fix the substitute mechanism, i.e., ensure the closure	Eelco Dolstra	16	-89/+255
	invariant by registering references through the manifest. * Added a test for nix-pull.
2005-01-25	* Fix the `--fallback' switch.	Eelco Dolstra	10	-86/+34
	* Fix the substitutes tests.
2005-01-25	* Fix the build hook mechanism; pass the pointer graph to the hook.	Eelco Dolstra	3	-5/+27

2005-01-25	* In nix-store: added query `--referers-closure' that returns the	Eelco Dolstra	5	-10/+31
	closure of the referers relation rather than the references relation, i.e., the set of all paths that directly or indirectly refer to the given path. Note that contrary to the references closure this set is not fixed; it can change as paths are added to or removed from the store.
2005-01-25	* In nix-store: change `--build' back to `--realise'. Also brought	Eelco Dolstra	7	-56/+100
	back the query flag `--force-realise'. * Fixed some of the tests.
2005-01-20	* Terminology fixes.	Eelco Dolstra	5	-22/+22

2005-01-20	* Ensure that derivation names and sources don't end in `.drv'.	Eelco Dolstra	1	-16/+8

2005-01-20	* Another change to low-level derivations. The last one this year, I	Eelco Dolstra	7	-32/+70
	promise :-) This allows derivations to specify on what output paths of input derivations they are dependent. This helps to prevent unnecessary downloads. For instance, a build might be dependent on the `devel' and `lib' outputs of some library component, but not the `docs' output.
2005-01-19	* Set the Perl search path properly (reported by Roy van den Broek).	Eelco Dolstra	1	-1/+1

2005-01-19	* Nix-store queries `--references' and `referers' to query the pointer	Eelco Dolstra	3	-18/+33
	graph. That is, `nix-store --query --references PATH' shows the set of paths referenced by PATH, and `nix-store --query --referers PATH' shows the set of paths referencing PATH.
2005-01-19	* Renamed `normalise.cc' -> `build.cc', `storeexprs.cc' ->	Eelco Dolstra	19	-98/+128
	`derivations.cc', etc. * Store the SHA-256 content hash of store paths in the database after they have been built/added. This is so that we can check whether the store has been messed with (a la `rpm --verify'). * When registering path validity, verify that the closure property holds.
2005-01-19	* `nix-store --build' now builds its arguments in parallel instead of	Eelco Dolstra	4	-24/+37
	sequentially (within the limits set by `--jobs'). This should greatly improve the utilisation of the build farm when doing Nixpkgs builds.
2005-01-19	* Change extension `.store' to `.drv'.	Eelco Dolstra	12	-139/+120
	* Re-enable `nix-store --query --requisites'.
2005-01-19	* Started removing closure store expressions, i.e., the explicit	Eelco Dolstra	15	-891/+408
	representation of closures as ATerms in the Nix store. Instead, the file system pointer graph is now stored in the Nix database. This has many advantages: - It greatly simplifies the implementation (we can drop the notion of `successors', and so on). - It makes registering roots for the garbage collector much easier. Instead of specifying the closure expression as a root, you can simply specify the store path that must be retained as a root. This could not be done previously, since there was no way to find the closure store expression containing a given store path. - Better traceability: it is now possible to query what paths are referenced by a path, and what paths refer to a path.
2005-01-19	* Support arities > 6.	Eelco Dolstra	1	-1/+7

2005-01-18	* Get --readonly-mode to work again.	Eelco Dolstra	1	-0/+11

2005-01-17	* Actually check that the result of fixed-output derivations matches	Eelco Dolstra	1	-0/+25
	the specified hash.
2005-01-17	* Removed the `id' attribute hack.	Eelco Dolstra	17	-101/+292
	* Formalise the notion of fixed-output derivations, i.e., derivations for which a cryptographic hash of the output is known in advance. Changes to such derivations should not propagate upwards through the dependency graph. Previously this was done by specifying the hash component of the output path through the `id' attribute, but this is insecure since you can lie about it (i.e., you can specify any hash and then produce a completely different output). Now the responsibility for checking the output is moved from the builder to Nix itself. A fixed-output derivation can be created by specifying the `outputHash' and `outputHashAlgo' attributes, the latter taking values `md5', `sha1', and `sha256', and the former specifying the actual hash in hexadecimal or in base-32 (auto-detected by looking at the length of the attribute value). MD5 is included for compatibility but should be considered deprecated. * Removed the `drvPath' pseudo-attribute in derivation results. It's no longer necessary. * Cleaned up the support for multiple output paths in derivation store expressions. Each output now has a unique identifier (e.g., `out', `devel', `docs'). Previously there was no way to tell output paths apart at the store expression level. * `nix-hash' now has a flag `--base32' to specify that the hash should be printed in base-32 notation. * `fetchurl' accepts parameters `sha256' and `sha1' in addition to `md5'. * `nix-prefetch-url' now prints out a SHA-1 hash in base-32. (TODO: a flag to specify the hash.)
2005-01-14	* Shorten SHA-256 hashes used in store path name generation to 160	Eelco Dolstra	7	-36/+108
	bits, then encode them in a radix-32 representation (using digits and letters except e, o, u, and t). This produces store paths like /nix/store/4i0zb0z7f88mwghjirkz702a71dcfivn-aterm-2.3.1. The nice thing about this is that the hash part of the file name is still 32 characters, as before with MD5. (Of course, shortening SHA-256 to 160 bits makes it no better than SHA-160 in theory, but hopefully it's a bit more resistant to attacks; it's certainly a lot slower.)
2005-01-14	* Start move towards SHA-256 hashes instead of MD5.	Eelco Dolstra	9	-34/+63
	* Start cleaning up unique store path generation (they weren't always unique; in particular the suffix ("-aterm-2.2", "-builder.sh") was not part of the hash, therefore changes to the suffix would cause multiple store objects with the same hash).
2005-01-14	* Missing file.	Eelco Dolstra	1	-0/+50