about summary refs log tree commit diff
path: root/src/libstore
AgeCommit message (Collapse)AuthorFilesLines
2004-06-22 * Reduce gratuitous cut & pasting.Eelco Dolstra1-68/+55
2004-06-22 * Wrapper class around pids.Eelco Dolstra2-87/+37
2004-06-22 * Substitutes should occupy a build slot.Eelco Dolstra1-1/+15
2004-06-22 * Refactoring.Eelco Dolstra2-20/+7
2004-06-21 * Acquire a lock on the output path when running a substitute. AlsoEelco Dolstra1-0/+22
delete obstructing invalid paths.
2004-06-21 * Ugh, nasty Heisenbug due to an uninitialiased variable. The bugEelco Dolstra1-0/+1
only caused a crash if the program was *not* invoked with a high verbosity level.
2004-06-21 * Remove obstructing invalid store paths add[Text]ToStore().Eelco Dolstra1-0/+6
2004-06-21 * Wrap calls to registerSubstitute() in a single transaction toEelco Dolstra2-10/+6
improve throughput. * Don't build the `substitute-rev' table for now, since it caused Theta(N^2) time and log file consumption when adding N substitutes. Maybe we can do without it.
2004-06-21 * Disable calls to fsync() since Berkeley DB's DB_TXN_WRITE_NOSYNCEelco Dolstra1-0/+8
flag doesn't seem to work as advertised.
2004-06-20 * Re-enable support for substitutes in the normaliser.Eelco Dolstra3-83/+351
* A better substitute mechanism. Instead of generating a store expression for each store path for which we have a substitute, we can have a single store expression that builds a generic program that is invoked to build the desired store path, which is passed as an argument. This means that operations like `nix-pull' only produce O(1) files instead of O(N) files in the store when registering N substitutes. (It consumes O(N) database storage, of course, but that's not a performance problem). * Added a test for the substitute mechanism. * `nix-store --substitute' reads the substitutes from standard input, instead of from the command line. This prevents us from running into the kernel's limit on command line length.
2004-06-20 * Refactoring.Eelco Dolstra1-41/+2
2004-06-19 * Re-enable build hooks.Eelco Dolstra1-72/+325
2004-06-18 * Big refactoring. Move to a much more explicitly state machine basedEelco Dolstra3-764/+869
approach. This makes it much easier to add extra complexity in the normaliser / realiser (e.g., build hooks, substitutes).
2004-06-15 * Refactoring.Eelco Dolstra1-82/+18
2004-06-08 * Cleanup.Eelco Dolstra1-10/+17
2004-05-18 * Drain the output of the build hook to show error messages. UglyEelco Dolstra1-4/+26
hack.
2004-05-18 * setpgrp() is not POSIX (and on Mac OS X it's different than onEelco Dolstra1-1/+1
Linux), so use setpgid().
2004-05-14 * execl() requires a terminating 0.Eelco Dolstra1-10/+21
* When a fast build wakes up a goal, try to start that goal in the same iteration of the startBuild() loop of run(). Otherwise no job might be started until the next job terminates.
2004-05-13 * Distributed builds and load balancing now seem to work pretty well.Eelco Dolstra1-24/+74
(Though the `build-remote.pl' script has a gigantic race condition).
2004-05-13 * Load balancing. `build-remote.pl' will only execute up to aEelco Dolstra1-1/+1
per-machine maximum number of parallel jobs on a remote machine.
2004-05-13 * The build hooks used to implement distributed builds can now be runEelco Dolstra1-134/+346
in parallel. Hooks are more efficient: locks on output paths are only acquired when the hook says that it is willing to accept a build job. Hooks now work in two phases. First, they should first tell Nix whether they are willing to accept a job. Nix guarantuees that no two hooks will ever be in the first phase at the same time (this simplifies the implementation of hooks, since they don't have to perform locking (?)). Second, if they accept a job, they are then responsible for building it (on the remote system), and copying the result back. These can be run in parallel with other hooks and locally executed jobs. The implementation is a bit messy right now, though. * The directory `distributed' shows a (hacky) example of a hook that distributes build jobs over a set of machines listed in a configuration file.
2004-05-12 * A switch `-j NUMBER' to set the maximum number of parallel jobs (0 =Eelco Dolstra3-5/+13
no limit). * Add missing file to distribution.
2004-05-12 * Pass to the build hook all sorts of information useful forEelco Dolstra1-6/+41
distributing a build action to another machine. In particular, the paths in the input closures, the output paths, and successor mapping for sub-derivations.
2004-05-12 * An quick and dirty hack to support distributed builds.Eelco Dolstra1-1/+21
2004-05-11 * True parallel builds. Nix can now run as many build jobs inEelco Dolstra7-286/+658
parallel as possible (similar to GNU Make's `-j' switch). This is useful on SMP systems, but it is especially useful for doing builds on multiple machines. The idea is that a large derivation is initiated on one master machine, which then distributes sub-derivations to any number of slave machines. This should not happen synchronously or in lock-step, so the master must be capable of dealing with multiple parallel build jobs. We now have the infrastructure to support this. TODO: substitutes are currently broken.
2004-04-14 * Be stricter in verifying store paths.Eelco Dolstra3-4/+9
2004-03-22 * Some more nesting.Eelco Dolstra1-4/+13
2004-03-12 * Set the NIX_STORE and NIX_BUILD_TOP environment variables inEelco Dolstra3-3/+19
builders to point to the store and the temporary build directory, respectively. Useful for purity checking. * Also set TEMPDIR, TMPDIR, TEMP, and TEMP to NIX_BUILD_TOP to make sure that tools in the builder store temporary files in the right location.
2004-02-16 * Allow linking against an external Berkeley DB / ATerm library.Eelco Dolstra1-1/+1
2004-02-14 * The environment variable NIX_ROOT can now be set to execute Nix in aEelco Dolstra1-9/+29
chroot() environment. * A operation `--validpath' to register path validity. Useful for bootstrapping in a pure Nix environment. * Safety checks: ensure that files involved in store operations are in the store.
2004-02-13 * Regression fix: realise substitutes and detect cycles.Eelco Dolstra1-1/+8
2004-01-15 * Catch SIGINT to terminate cleanly when the user tries to interruptEelco Dolstra6-4/+27
Nix. This is to prevent Berkeley DB from becoming wedged. Unfortunately it is not possible to throw C++ exceptions from a signal handler. In fact, you can't do much of anything except change variables of type `volatile sig_atomic_t'. So we set an interrupt flag in the signal handler and check it at various strategic locations in the code (by calling checkInterrupt()). Since this is unlikely to cover all cases (e.g., (semi-)infinite loops), sometimes SIGTERM may now be required to kill Nix.
2004-01-13 * Option `-B' to always show the output of builders, regardless ofEelco Dolstra3-1/+7
verbosity level.
2004-01-13 * Periodically checkpoint the log.Eelco Dolstra1-1/+3
2004-01-13 * Tricky: make sure that the accessor count is not reset to 0 ifEelco Dolstra1-1/+5
recovery fails.
2004-01-13 * Print error messages, not debug messages.Eelco Dolstra1-5/+9
2004-01-12 * Changed the extension for store expressions from ".nix" to ".store"Eelco Dolstra1-1/+1
(following the Usenix paper).
2004-01-07 * Upgraded to Berkeley DB 4.2.52. The main advantage of 4.2 is thatEelco Dolstra1-1/+1
it automatically removes log files when they are no longer needed. *** IMPORTANT *** If you have an existing Nix installation, you must checkpoint the Nix database to prevent recent transactions from being undone. Do the following: - optional: make a backup of $prefix/var/nix/db. - run `db_checkpoint' from Berkeley DB 4.1: $ db_checkpoint -h $prefix/var/nix/db -1 - optional (?): run `db_recover' from Berkeley DB 4.1: $ db_recover -h $prefix/var/nix/db - remove $prefix/var/nix/db/log* and $prefix/var/nix/db/__db*
2004-01-05 * Implemented Eelco V.'s `nix-env -I' command to specify the defaultEelco Dolstra1-6/+2
path of the Nix expression to be used with the import, upgrade, and query commands. For instance, $ nix-env -I ~/nixpkgs/pkgs/system/i686-linux.nix $ nix-env --query --available [aka -qa] sylpheed-0.9.7 bison-1.875 pango-1.2.5 subversion-0.35.1 ... $ nix-env -i sylpheed $ nix-env -u subversion There can be only one default at a time. * If the path to a Nix expression is a symlink, follow the symlink prior to resolving relative path references in the expression.
2003-12-22 * GCC 2.95 compatibility.Eelco Dolstra2-0/+2
2003-12-21 * Bug fix: parallel builds of the same derivation failed due to lock file ↵Eelco Dolstra1-3/+5
removal.
2003-12-05 * Allow successors that don't exist but have a substitute.Eelco Dolstra1-34/+73
* Integrity: check in successor / substitute registration whether the target path exists or has a substitute.
2003-12-01 * Use a system name that does not include the OS manufacturer (i.e.,Eelco Dolstra1-1/+1
"i686-linux" instead of "i686-suse-linux").
2003-11-25 * More `make dist' fixes.Eelco Dolstra1-4/+4
2003-11-25 * `make dist' fix.Eelco Dolstra1-8/+1
2003-11-24 * Bug fix in path invalidation.Eelco Dolstra1-23/+41
* More consistency checks.
2003-11-22 * Maintain integrity of the substitute and successor mappings whenEelco Dolstra3-40/+55
deleting a path in the store. * Allow absolute paths in Nix expressions. * Get nix-prefetch-url to work again. * Various other fixes.
2003-11-22 * Fix the garbage collector.Eelco Dolstra1-8/+1
2003-11-21 * Remove lock files after building. Eelco Dolstra3-1/+20
2003-11-19 * nix-env: a tool to manage user environments.Eelco Dolstra4-10/+10
* Replace all directory reading code by a generic readDirectory() function.