depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2012-09-19	Support xz compression in the download-using-manifests substituter	Eelco Dolstra	1	-0/+1

2012-07-27	Allow a binary cache to declare that it doesn't support "nix-env -qas"	Eelco Dolstra	1	-12/+20
	Querying all substitutable paths via "nix-env -qas" is potentially hard on a server, since it involves sending thousands of HEAD requests. So a binary cache must now have a meta-info file named "nix-cache-info" that specifies whether the server wants this. It also specifies the store prefix so that we don't send useless queries to a binary cache for a different store prefix.
2012-07-26	nix-push: Support generating a manifest again	Eelco Dolstra	1	-10/+34
	This makes all the tests succeed. Woohoo!
2012-07-26	nix-push: Remove the upload feature	Eelco Dolstra	1	-51/+24

2012-07-02	nix-push: Always generate base-32 hashes	Eelco Dolstra	1	-2/+2

2012-07-02	Binary caches: use a better key	Eelco Dolstra	1	-3/+3
	Use the hash part of the store path as a key rather than a hash of the store path. This is enough to get the desired privacy property.
2012-07-01	Allow both bzip2 and xz compression	Eelco Dolstra	1	-20/+41

2012-06-29	nix-push: Don't pollute the current directory with result symlink	Eelco Dolstra	1	-1/+1

2012-06-29	Doh	Eelco Dolstra	1	-1/+1

2012-06-29	Use XZ compression in binary caches	Eelco Dolstra	1	-13/+13
	XZ compresses significantly better than bzip2. Here are the compression ratios and execution times (using 4 cores in parallel) on my /var/run/current-system (3.1 GiB): bzip2: total compressed size 849.56 MiB, 30.8% [2m08] xz -6: total compressed size 641.84 MiB, 23.4% [6m53] xz -7: total compressed size 621.82 MiB, 22.6% [7m19] xz -8: total compressed size 599.33 MiB, 21.8% [7m18] xz -9: total compressed size 588.18 MiB, 21.4% [7m40] Note that compression takes much longer. More importantly, however, decompression is much faster: bzip2: 1m47.274s xz -6: 0m55.446s xz -7: 0m54.119s xz -8: 0m52.388s xz -9: 0m51.842s The only downside to using -9 is that decompression takes a fair amount (~65 MB) of memory.
2012-06-28	nix-push: create a manifest-less binary cache	Eelco Dolstra	1	-159/+93
	Manifests are a huge pain, since users need to run nix-pull directly or indirectly to obtain them. They tend to be large and lag behind the available binaries; also, the downloaded manifests in /nix/var/nix/manifest need to be in sync with the Nixpkgs sources. So we want to get rid of them. The idea of manifest-free operation works as follows. Nix is configured with a set of URIs of binary caches, e.g. http://nixos.org/binary-cache Whenever Nix needs a store path X, it checks each binary cache for the existence of a file <CACHE-URI>/<SHA-256 hash of X>.narinfo, e.g. http://nixos.org/binary-cache/bi1gh9...ia17.narinfo The .narinfo file contains the necessary information about the store path that was formerly kept in the manifest, i.e., (relative) URI of the compressed NAR, references, size, hash, etc. For example: StorePath: /nix/store/xqp4l88cr9bxv01jinkz861mnc9p7qfi-neon-0.29.6 URL: 1bjxbg52l32wj8ww47sw9f4qz0r8n5vs71l93lcbgk2506v3cpfd.nar.bz2 CompressedHash: sha256:1bjxbg52l32wj8ww47sw9f4qz0r8n5vs71l93lcbgk2506v3cpfd CompressedSize: 202542 NarHash: sha256:1af26536781e6134ab84201b33408759fc59b36cc5530f57c0663f67b588e15f NarSize: 700440 References: 043zrsanirjh8nbc5vqpjn93hhrf107f-bash-4.2-p24 cj7a81wsm1ijwwpkks3725661h3263p5-glibc-2.13 ... Deriver: 4idz1bgi58h3pazxr3akrw4fsr6zrf3r-neon-0.29.6.drv System: x86_64-linux Nix then knows that it needs to download http://nixos.org/binary-cache/1bjxbg52l32wj8ww47sw9f4qz0r8n5vs71l93lcbgk2506v3cpfd.nar.bz2 to substitute the store path. Note that the store directory is omitted from the References and Deriver fields to save space, and that the URL can be relative to the binary cache prefix. This patch just makes nix-push create binary caches in this format. The next step is to make a substituter that supports them.
2012-04-14	Remove unnecessary "system" argument	Eelco Dolstra	1	-1/+1

2012-01-03	* Use Nix::Config.	Eelco Dolstra	1	-10/+8

2012-01-03	* Refactoring: Get rid of a few subdirectories in corepkgs/, and some	Eelco Dolstra	1	-4/+1
	other simplifications. * Use <nix/...> to locate the corepkgs. This allows them to be overriden through $NIX_PATH. * Use bash's pipefail option in the NAR builder so that we don't need to create a temporary file.
2011-11-29	* For consistency with "nix-store -q --hash", produce hashes in	Eelco Dolstra	1	-2/+2
	base-32. (This affects Hydra manifests.)
2011-10-10	* Set the executable bit on scripts.	Eelco Dolstra	1	-0/+0

2011-10-10	* Install NixManifest.pm, NixConfig.pm and GeneratePatches.pm under	Eelco Dolstra	1	-4/+5
	the Nix:: namespace.
2011-04-11	* configure: detect whether DBD::SQLite is present. If necessary the	Eelco Dolstra	1	-1/+1
	location to DBI and DBD::SQLite can be passed with --with-dbi and --with-dbd-sqlite.
2011-04-11	* Subtle bug: if you import File::stat in one module, it affects other	Eelco Dolstra	1	-1/+2
	modules as well. So use symbolic field names everywhere (which is nicer anyway).
2011-02-17	(no commit message)	Eelco Dolstra	1	-1/+1

2011-02-17	* nix-push: handle the case where the hash is not set in the DB.	Eelco Dolstra	1	-0/+10

2010-12-05	* Use CamelCase for the Perl modules.	Eelco Dolstra	1	-1/+1

2010-11-17	* Store the NAR size in the manifest.	Eelco Dolstra	1	-0/+5

2010-11-17	* nix-push: no need to compute the NAR hash, since the Nix database	Eelco Dolstra	1	-7/+5
	already has it (`nix-store -q --hash').
2009-03-18	* Unify exportReferencesGraph and exportBuildReferencesGraph, and make	Eelco Dolstra	1	-5/+1
	sure that it works as expected when you pass it a derivation. That is, we have to make sure that all build-time dependencies are built, and that they are all in the input closure (otherwise remote builds might fail, for example). This is ensured at instantiation time by adding all derivations and their sources to inputDrvs and inputSrcs.
2008-12-04	* Dirty hack to make nix-push work properly on derivations: the	Eelco Dolstra	1	-2/+1
	derivation should be a source rather than a derivation dependency of the call to the NAR derivation. Otherwise the derivation (and all its dependencies) will be built as a side-effect, which may not even succeed.
2008-11-20	* Urgh.	Eelco Dolstra	1	-2/+1

2008-11-19	* Primop builtins.storePath for declaring a store path as a	Eelco Dolstra	1	-1/+1
	dependency. `storePath /nix/store/bla' gives exactly the same result as `toPath /nix/store/bla', except that the former includes /nix/store/bla in the dependency context of the string. Useful in some generated Nix expressions like nix-push, which now finally does the right thing wrt distributed builds. (Previously the path to be packed wasn't an explicit dependency, so it wouldn't be copied to the remote machine.)
2008-03-20	* Cleanup.	Eelco Dolstra	1	-5/+9

2007-12-30	* Don't use "store expression", it's obsolete.	Eelco Dolstra	1	-2/+2

2007-11-16	* Flag `--no-build-hook' to disable distributed builds.	Eelco Dolstra	1	-1/+1
	* queryDeriver in daemon mode: don't barf if the other side returns an empty string (which means there is no deriver).
2007-09-04	* nix-push / generate-patches: bzip the manifest.	Eelco Dolstra	1	-0/+4

2007-08-15	* Show errors in nix-prefetch-url.	Eelco Dolstra	1	-1/+1

2006-10-04	* tmpnam() -> File::Temp::tempdir().	Eelco Dolstra	1	-10/+7

2006-09-25	* Clean up calls to system().	Eelco Dolstra	1	-1/+1

2006-09-25	* Use builtins.toPath.	Eelco Dolstra	1	-2/+2

2006-09-20	* Use paths, not strings, when calling the function that generates	Eelco Dolstra	1	-10/+17
	NARs. Fixes the impurity of nix-push (NIX-21). * Better help.
2006-08-09	* file:/ -> file://	Eelco Dolstra	1	-1/+1

2006-08-08	rework the --target flag. If this flag is used, a URI should be given. Default	Armijn Hemel	1	-4/+4
	values are not changed.
2006-08-07	* In nar.nix, path -> storePath, otherwise we get a collision between	Eelco Dolstra	1	-1/+1
	environment variable names on Cygwin (where they are case insensitive).
2006-08-03	urgh...for some weird reason this one-liner was not in svn. PEBKAC!	Armijn Hemel	1	-1/+1

2006-08-01	add a flag --target, so we can override the URL in the MANIFEST file. This	Armijn Hemel	1	-0/+9
	is only for local copies (so file:///)
2005-11-17	* FreeBSD compatibility fix.	Eelco Dolstra	1	-1/+2

2005-10-29	* Turn off build hooks in nix-push because of an impurity (NIX-21).	Eelco Dolstra	1	-1/+11

2005-09-21	* Remove other uses of IPC::Open2.	Eelco Dolstra	1	-20/+8

2005-03-15	* Use SHA-256 for nix-push.	Eelco Dolstra	1	-17/+29

2005-03-14	* Set NAR name to content hash; previous nix-push names were not	Eelco Dolstra	1	-11/+10
	unique. * Drop `hashAlgo' attribute in manifests; prefix hashes with the hash algorithm instead.
2005-02-24	* (Unnecessary) refactoring.	Eelco Dolstra	1	-29/+36

2005-02-17	* Fix nix-channel.	Eelco Dolstra	1	-6/+6
	* Add `--help' flag; fixes NIX-5. * Add `--remove' flag; fixes NIX-6. * Add `--list' flag.
2005-02-09	* Propagate the deriver of a path through the substitute mechanism.	Eelco Dolstra	1	-19/+10
	* Removed some dead code (successor stuff) from nix-push. * Updated terminology in the tests (store expr -> drv path). * Check that the deriver is set properly in the tests.