about summary refs log tree commit diff
path: root/src/nix-store
AgeCommit message (Collapse)AuthorFilesLines
2005-02-09 * Propagate the deriver of a path through the substitute mechanism.Eelco Dolstra1-0/+1
* Removed some dead code (successor stuff) from nix-push. * Updated terminology in the tests (store expr -> drv path). * Check that the deriver is set properly in the tests.
2005-02-08 * Subflag in `--verify': `nix-store --verify --check-contents' checksEelco Dolstra1-1/+11
that the contents of store paths has not changed by comparing hashes of their current contents to the hashes stored in the database.
2005-02-08 * Updated `nix-store --verify' to the new schema.Eelco Dolstra1-2/+2
2005-02-07 * `nix-store -qb' to query derivation environment bindings. UsefulEelco Dolstra1-11/+32
for finding build-time dependencies (possibly after a build). E.g., $ nix-store -qb aterm $(nix-store -qd $(which strc)) /nix/store/jw7c7s65n1gwhxpn35j9rgcci6ilzxym-aterm-2.3.1 * Arguments to nix-store can be files within store objects, e.g., /nix/store/jw7c...-aterm-2.3.1/bin/baffle. * Idem for garbage collector roots.
2005-02-07 * Maintain a database table (`derivers') that maps output paths to theEelco Dolstra1-2/+15
derivation that produced them. * `nix-store -qd PATH' prints out the derivation that produced a path.
2005-02-01 * Move root finding from `nix-collect-garbage' to `nix-store --gc'.Eelco Dolstra1-15/+5
This was necessary becase root finding must be done after acquisition of the global GC lock. This makes `nix-collect-garbage' obsolete; it is now just a wrapper around `nix-store --gc'. * Automatically remove stale GC roots (i.e., indirect GC roots that point to non-existent paths).
2005-02-01 * nix-build: use an indirection scheme to make it easier for users toEelco Dolstra1-10/+11
get rid of GC roots. Nix-build places a symlink `result' in the current directory. Previously, removing that symlink would not remove the store path being linked to as a GC root. Now, the GC root created by nix-build is actually a symlink in `/nix/var/nix/gcroots/auto' to `result'. So if that symlink is removed the GC root automatically becomes invalid (since it can no longer be resolved). The root itself is not automatically removed - the garbage collector should delete dangling roots.
2005-02-01 * nix-store, nix-instantiate: added an option `--add-root' toEelco Dolstra2-3/+45
immediately add the result as a permanent GC root. This is the only way to prevent a race with the garbage collector. For instance, the old style ln -s $(nix-store -r $(nix-instantiate foo.nix)) \ /nix/var/nix/gcroots/result has two time windows in which the garbage collector can interfere (by GC'ing the derivation and the output, respectively). On the other hand, nix-store --add-root /nix/var/nix/gcroots/result -r \ $(nix-instantiate --add-root /nix/var/nix/gcroots/drv \ foo.nix) is safe. * nix-build: use `--add-root' to prevent GC races.
2005-01-27 * Fix and simplify the garbage collector (it's still not concurrent,Eelco Dolstra1-42/+13
though). In particular it's now much easier to register a GC root. Just place a symlink to whatever store path it is that you want to keep in /nix/var/nix/gcroots.
2005-01-25 * Maintain the references/referers relation also for derivations.Eelco Dolstra1-1/+36
This simplifies garbage collection and `nix-store --query --requisites' since we no longer need to treat derivations specially. * Better maintaining of the invariants, e.g., setReferences() can only be called on a valid/substitutable path.
2005-01-25 * Simplification: registerSubstitutes -> registerSubstitute. We noEelco Dolstra1-4/+1
longer need the former since there we no longer have the substitutes-rev table (which triggered a O(n^2) cost in updating them).
2005-01-25 * Really fix the substitute mechanism, i.e., ensure the closureEelco Dolstra1-1/+9
invariant by registering references through the manifest. * Added a test for nix-pull.
2005-01-25 * In nix-store: added query `--referers-closure' that returns theEelco Dolstra2-4/+16
closure of the referers relation rather than the references relation, i.e., the set of all paths that directly or indirectly refer to the given path. Note that contrary to the references closure this set is not fixed; it can change as paths are added to or removed from the store.
2005-01-25 * In nix-store: change `--build' back to `--realise'. Also broughtEelco Dolstra2-12/+36
back the query flag `--force-realise'. * Fixed some of the tests.
2005-01-19 * Nix-store queries `--references' and `referers' to query the pointerEelco Dolstra1-18/+19
graph. That is, `nix-store --query --references PATH' shows the set of paths referenced by PATH, and `nix-store --query --referers PATH' shows the set of paths referencing PATH.
2005-01-19 * Renamed `normalise.cc' -> `build.cc', `storeexprs.cc' ->Eelco Dolstra3-4/+4
`derivations.cc', etc. * Store the SHA-256 content hash of store paths in the database after they have been built/added. This is so that we can check whether the store has been messed with (a la `rpm --verify'). * When registering path validity, verify that the closure property holds.
2005-01-19 * `nix-store --build' now builds its arguments in parallel instead ofEelco Dolstra1-1/+2
sequentially (within the limits set by `--jobs'). This should greatly improve the utilisation of the build farm when doing Nixpkgs builds.
2005-01-19 * Change extension `.store' to `.drv'.Eelco Dolstra2-41/+42
* Re-enable `nix-store --query --requisites'.
2005-01-19 * Started removing closure store expressions, i.e., the explicitEelco Dolstra2-32/+14
representation of closures as ATerms in the Nix store. Instead, the file system pointer graph is now stored in the Nix database. This has many advantages: - It greatly simplifies the implementation (we can drop the notion of `successors', and so on). - It makes registering roots for the garbage collector much easier. Instead of specifying the closure expression as a root, you can simply specify the store path that must be retained as a root. This could not be done previously, since there was no way to find the closure store expression containing a given store path. - Better traceability: it is now possible to query what paths are referenced by a path, and what paths refer to a path.
2005-01-13 * Refactoring to support SHA-1.Eelco Dolstra1-3/+3
2004-12-20 * Simplify the substitute mechanism:Eelco Dolstra2-1/+14
- Drop the store expression. So now a substitute is just a command-line invocation (a program name + arguments). If you register a substitute you are responsible for registering the expression that built it (if any) as a root of the garbage collector. - Drop the substitutes-rev DB table.
2004-09-10 * Operation `--delete-generations' to delete generations of aEelco Dolstra1-9/+5
profile. Arguments are either generation number, or `old' to delete all non-current generations. Typical use: $ nix-env --delete-generations old $ nix-collect-garbage * istringstream -> string2Int.
2004-08-31 * Main the `substitutes-rev' table again, but now in a way thatEelco Dolstra1-1/+4
doesn't take \Theta(n^2) space/time complexity.
2004-08-25 * `--min-age' flag in nix-store and nix-collect-garbage to only deleteEelco Dolstra1-10/+15
unreachable paths that haven't been used for N hours. For instance, `nix-collect-garbage --min-age 168' only deletes paths that haven't been accessed in the last week. This is useful for instance in the build farm where many derivations can be shared between consecutive builds, and we wouldn't want a garbage collect to throw them all away. We could of course register them as roots, but then we'd to unregister them at some point, which would be a pain to manage. The `--min-age' flag gives us a sort of MRU caching scheme. BUG: this really shouldn't be in gc.cc since that violates mechanism/policy separation.
2004-08-25 * `nix-collect-garbage' now actually performs a garbage collection, itEelco Dolstra1-1/+1
doesn't just print the set of paths that should be deleted. So there is no more need to pipe the result into `nix-store --delete' (which doesn't even exist anymore).
2004-08-25 * Put the garbage collector in nix-store: operation `--gc',Eelco Dolstra1-13/+57
suboperations `--print-live', `--print-dead', and `--delete'. The roots are not determined by nix-store; they are read from standard input. This is to make it easy to customise what the roots are. The collector now no longer fails when store expressions are missing (which legally happens when using substitutes). It never tries to fetch paths through substitutes. TODO: acquire a global lock on the store while garbage collecting. * Removed `nix-store --delete'.
2004-06-28 * Added a switch `--fallback'. From the manual:Eelco Dolstra1-4/+2
Whenever Nix attempts to realise a derivation for which a closure is already known, but this closure cannot be realised, fall back on normalising the derivation. The most common scenario in which this is useful is when we have registered substitutes in order to perform binary distribution from, say, a network repository. If the repository is down, the realisation of the derivation will fail. When this option is specified, Nix will build the derivation instead. Thus, binary installation falls back on a source installation. This option is not the default since it is generally not desirable for a transient failure in obtaining the substitutes to lead to a full build from source (with the related consumption of resources).
2004-06-21 * Remove debug output.Eelco Dolstra1-1/+0
2004-06-21 * Wrap calls to registerSubstitute() in a single transaction toEelco Dolstra1-1/+7
improve throughput. * Don't build the `substitute-rev' table for now, since it caused Theta(N^2) time and log file consumption when adding N substitutes. Maybe we can do without it.
2004-06-20 * Re-enable support for substitutes in the normaliser.Eelco Dolstra1-23/+31
* A better substitute mechanism. Instead of generating a store expression for each store path for which we have a substitute, we can have a single store expression that builds a generic program that is invoked to build the desired store path, which is passed as an argument. This means that operations like `nix-pull' only produce O(1) files instead of O(N) files in the store when registering N substitutes. (It consumes O(N) database storage, of course, but that's not a performance problem). * Added a test for the substitute mechanism. * `nix-store --substitute' reads the substitutes from standard input, instead of from the command line. This prevents us from running into the kernel's limit on command line length.
2004-04-21 * Do initialise state (the DB etc.) when doing a `make install',Eelco Dolstra1-7/+0
unless `--disable-init-state' is passed to configure.
2004-02-16 * Allow linking against an external Berkeley DB / ATerm library.Eelco Dolstra1-2/+2
2004-02-16 * Allow the location of the store to be specified (--with-store-dir).Eelco Dolstra1-1/+1
* Do not create stuff in localstatedir when doing `make install' (since we may not have write access). In general, installation of constant code/data should be separate from the initialisation of mutable state.
2004-02-14 * The environment variable NIX_ROOT can now be set to execute Nix in aEelco Dolstra2-3/+34
chroot() environment. * A operation `--validpath' to register path validity. Useful for bootstrapping in a pure Nix environment. * Safety checks: ensure that files involved in store operations are in the store.
2004-02-06 * Improvements to profiles. Generations are now per-profile, e.g.,Eelco Dolstra1-3/+0
default -> default-94-link default-82-link -> /nix/store/cc4480... default-83-link -> /nix/store/caeec8... ... default-94-link -> /nix/store/2896ca... experimental -> experimental-2-link experimental-1-link -> /nix/store/cc4480... experimental-2-link -> /nix/store/a3148f... * `--profile' / `-p' -> `--switch-profile' / `-S' * `--link' / `-l' -> `--profile' / `-p' * The default profile is stored in $prefix/var/nix/profiles. $prefix/var/nix/links is gone. Profiles can be stored anywhere. * The current profile is now referenced from ~/.nix-profile, not ~/.nix-userenv. * The roots to the garbage collector now have extension `.gcroot', not `.id'.
2004-01-09 * Option `--force-realise' in `nix-store --query'.Eelco Dolstra1-5/+12
2003-12-30 * RPM spec file.Eelco Dolstra1-8/+8
* Respect DESTDIR variable.
2003-12-01 * Help text for all (non-script) programs, so no more:Eelco Dolstra2-10/+2
$ nix-instantiate --help error: unknown flag `--help` Try `nix-instantiate --help' for more information. :-)
2003-11-25 * Another fix.Eelco Dolstra1-1/+1
2003-11-25 * More `make dist' fixes.Eelco Dolstra1-3/+1
2003-11-19 * nix-env: a tool to manage user environments.Eelco Dolstra1-3/+2
* Replace all directory reading code by a generic readDirectory() function.
2003-11-18 * "Fix expression" -> "Nix expression".Eelco Dolstra3-9/+6
* More refactoring.
2003-11-18 * nix -> nix-store, fix -> nix-instantiate.Eelco Dolstra5-0/+508