depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2017-09-06	Fix abort when the GC thread gets an exception	Eelco Dolstra	1	-13/+21

2017-09-05	Add automatic garbage collection	Eelco Dolstra	5	-1/+123
	Nix can now automatically run the garbage collector during builds or while adding paths to the store. The option "min-free = <bytes>" specifies that Nix should run the garbage collector whenever free space in the Nix store drops below <bytes>. It will then delete garbage until "max-free" bytes are available. Garbage collection during builds is asynchronous; running builds are not paused and new builds are not blocked. However, there also is a synchronous GC run prior to the first build/substitution. Currently, no old GC roots are deleted (as in "nix-collect-garbage -d").
2017-09-05	GC: Don't delete own temproots file	Eelco Dolstra	3	-34/+34
	Since file locks are per-process rather than per-file-descriptor, the garbage collector would always acquire a lock on its own temproots file and conclude that it's stale.
2017-09-01	Abort curl downloads if there is no progress for 5 minutes	Eelco Dolstra	1	-1/+6
	Maybe this will fix the curl hangs on macOS. (We could also use CURLOPT_TIMEOUT but that seems more of a sledgehammer.)
2017-08-31	Call queryMissing() prior to building	Eelco Dolstra	2	-0/+14
	Without this, substitute info is fetched sequentially, which is superslow. In the old UI (e.g. nix-build), we call printMissing(), which calls queryMissing(), thereby preheating the binary cache cache. But the new UI doesn't do that.
2017-08-31	Add an activity for binary cache queries	Eelco Dolstra	2	-1/+8

2017-08-31	Rename a few configuration options	Eelco Dolstra	3	-44/+56
	In particular, drop the "build-" and "gc-" prefixes which are pointless. So now you can say nix build --no-sandbox instead of nix build --no-build-use-sandbox
2017-08-28	Give activities a verbosity level again	Eelco Dolstra	5	-9/+12
	And print them (separately from the progress bar) given sufficient -v flags.
2017-08-28	Don't send progress messages to older clients	Eelco Dolstra	1	-1/+1

2017-08-28	Tunnel progress messages from the daemon to the client	Eelco Dolstra	2	-11/+61
	This makes the progress bar work for non-root users.
2017-08-25	Simplify	Eelco Dolstra	1	-10/+36

2017-08-25	Allow derivations to update the build phase	Eelco Dolstra	1	-0/+5
	So the progress bar can show [1/0/1 built, 0.0 MiB DL] building hello-2.10 (configuring): checking whether pread is declared without a macro... yes
2017-08-25	Allow activities to be nested	Eelco Dolstra	4	-6/+13
	In particular, this allows more relevant activities ("substituting X") to supersede inferior ones ("downloading X").
2017-08-25	Restore activity metadata	Eelco Dolstra	1	-2/+5
	This allows the progress bar to display "building perl-5.22.3" instead of "building /nix/store/<hash>-perl-5.22.3.drv".
2017-08-21	Clean up JSON construction	Eelco Dolstra	1	-3/+18

2017-08-21	Allow builders to create activities	Eelco Dolstra	1	-6/+72
	Actually, currently they can only create download activities. Thus, downloads by builtins.fetchurl show up in the progress bar.
2017-08-16	nix optimise-store: Show how much space has been freed	Eelco Dolstra	3	-7/+11

2017-08-16	nix optimise-store: Add	Eelco Dolstra	1	-2/+12
	This replaces "nix-store --optimise". Main difference is that it has a progress indicator.
2017-08-16	Progress indicator: Cleanup	Eelco Dolstra	3	-12/+11

2017-08-16	Progress indicator: More improvements	Eelco Dolstra	1	-9/+47

2017-08-16	Progress indicator: Show number of active items	Eelco Dolstra	2	-13/+12

2017-08-16	Progress indicator: Unify "copying" and "substituting"	Eelco Dolstra	2	-14/+16
	They're the same thing after all. Example: $ nix build --store local?root=/tmp/nix nixpkgs.firefox-unwrapped [0/1 built, 49/98 copied, 16.3/92.8 MiB DL, 55.8/309.2 MiB copied] downloading 'https://cache.nixos.org/nar/0pl9li1jigcj2dany47hpmn0r3r48wc4nz48v5mqhh426lgz3bz6.nar.xz'
2017-08-16	Improve substitution progress indicator	Eelco Dolstra	2	-7/+59
	E.g. $ nix build --store local?root=/tmp/nix nixpkgs.firefox-unwrapped [0/1 built, 1/97/98 fetched, 65.8/92.8 MiB DL, 203.2/309.2 MiB copied] downloading 'https://cache.nixos.org/nar/1czm9fk0svacy4h6a3fzkpafi4f7a9gml36kk8cq1igaghbspg3k.nar.xz'
2017-08-16	nix copy: Improve progress indicator	Eelco Dolstra	1	-4/+28
	It now shows the amount of data copied: [8/1038 copied, 160.4/1590.9 MiB copied] copying path '...'
2017-08-16	nix copy: Revive progress bar	Eelco Dolstra	2	-2/+25

2017-08-16	Disallow SSH host names starting with a dash	Eelco Dolstra	2	-8/+12

2017-08-10	Style fix	Eelco Dolstra	1	-1/+2

2017-08-09	Use /proc/self/fd to efficiently close all FDs on Linux	Eelco Dolstra	1	-1/+1
	Issue #1506.
2017-07-31	Merge branch 'macOS' of https://github.com/davidak/nix	Eelco Dolstra	1	-2/+2

2017-07-30	Replace Unicode quotes in user-facing strings by ASCII	Jörg Thalheim	28	-320/+320
	Relevant RFC: NixOS/rfcs#4 $ ag -l \| xargs sed -i -e "/\"/s/’/'/g;/\"/s/‘/'/g"
2017-07-30	replace "OS X" with "macOS"	davidak	1	-2/+2

2017-07-20	FD_SETSIZE check: BuildError -> Error	Eelco Dolstra	1	-3/+2
	BuildError denotes a permanent build failure, which is not the case here.
2017-07-18	Do not try to fill fd_set with fd>=FD_SETSIZE	Dmitry Kalinkin	1	-0/+3
	This is UB and causes buffer overflow and crash on linux.
2017-07-17	Always use base-16 for hashed mirror lookups	Eelco Dolstra	1	-1/+2
	In particular, don't use base-64, which we don't support. (We do have base-32 redirects for hysterical reasons.) Also, add a test for the hashed mirror feature.
2017-07-17	Make the hashes mirrors used by builtins.fetchurl configurable	Eelco Dolstra	2	-6/+12
	In particular, this allows it to be disabled in our tests.
2017-07-17	Fix accidental printError	Eelco Dolstra	1	-1/+1

2017-07-14	nix path-info: Show download sizes for binary cache stores	Eelco Dolstra	2	-8/+29
	E.g. $ nix path-info --json --store https://cache.nixos.org nixpkgs.thunderbird -S ... "downloadHash": "sha256:1jlixpzi225wwa0f4xdrwrqgi47ip1qpj9p06fyxxg07sfmyi4q0", "downloadSize": 43047620, "closureDownloadSize": 84745960 } ]
2017-07-14	nix path-info: Don't barf on invalid paths	Eelco Dolstra	2	-29/+37
	Now you get [ { "path": "/nix/store/fzvliz4j5xzvnd0w5zgw2l0ksqh578yk-bla", "valid": false } ]
2017-07-11	fetchTarball: Prevent concurrent downloads of the same file	Eelco Dolstra	1	-0/+4
	Fixes #849.
2017-07-07	Merge pull request #1445 from matthewbauer/macos-skip-hardlink	Eelco Dolstra	1	-0/+14
	Don’t hardlink disallowed paths in OS X.
2017-07-06	Don’t hardlink disallowed paths in OS X.	Matthew Bauer	1	-0/+14
	Fixes #1443
2017-07-04	Add X32 to the seccomp filter	Eelco Dolstra	1	-0/+4
	Fixes #1432.
2017-07-04	Sort substituters by priority	Eelco Dolstra	3	-0/+11
	Fixes #1438.
2017-07-04	getDefaultSubstituters(): Simplify initialisation	Eelco Dolstra	1	-20/+14
	As shlevy pointed out, static variables in C++11 have thread-safe initialisation.
2017-07-04	Add allow-new-privileges option	Eelco Dolstra	2	-0/+9
	This allows builds to call setuid binaries. This was previously possible until we started using seccomp. Turns out that seccomp by default disallows processes from acquiring new privileges. Generally, any use of setuid binaries (except those created by the builder itself) is by definition impure, but some people were relying on this ability for certain tests. Example: $ nix build '(with import <nixpkgs> {}; runCommand "foo" {} "/run/wrappers/bin/ping -c 1 8.8.8.8; exit 1")' --no-allow-new-privileges builder for ‘/nix/store/j0nd8kv85hd6r4kxgnwzvr0k65ykf6fv-foo.drv’ failed with exit code 1; last 2 log lines: cannot raise the capability into the Ambient set : Operation not permitted $ nix build '(with import <nixpkgs> {}; runCommand "foo" {} "/run/wrappers/bin/ping -c 1 8.8.8.8; exit 1")' --allow-new-privileges builder for ‘/nix/store/j0nd8kv85hd6r4kxgnwzvr0k65ykf6fv-foo.drv’ failed with exit code 1; last 6 log lines: PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data. 64 bytes from 8.8.8.8: icmp_seq=1 ttl=46 time=15.2 ms Fixes #1429.
2017-07-04	Support base-64 hashes	Eelco Dolstra	12	-44/+33
	Also simplify the Hash API. Fixes #1437.
2017-07-03	Replace a few bool flags with enums	Eelco Dolstra	14	-123/+116
	Functions like copyClosure() had 3 bool arguments, which creates a severe risk of mixing up arguments. Also, implement copyClosure() using copyPaths().
2017-06-20	Call SetDllDirectory("") after sqlite3 init on cygwin	David McFarland	1	-0/+14
	Cygwin sqlite3 is patched to call SetDllDirectory("/usr/bin") on init, which affects the current process and is inherited by child processes. It causes DLLs to be loaded from /usr/bin/ before $PATH, which breaks all sorts of things. A typical failures would be header/lib version mismatches (e.g. openssl when running checkPhase on openssh). We'll just set it back to the default value. Note that this is a problem with the cygwin version of sqlite3 (currently 3.18.0). nixpkgs doesn't have the problematic patch.
2017-06-19	Disable use of virtual hosting in aws-sdk-cpp	Eelco Dolstra	1	-1/+1
	Recently aws-sdk-cpp quietly switched to using S3 virtual host URIs (https://github.com/aws/aws-sdk-cpp/commit/69d9c53882), i.e. it sends requests to http://<bucket>.<region>.s3.amazonaws.com rather than http://<region>.s3.amazonaws.com/<bucket>. However this interacts badly with curl connection reuse. For example, if we do the following: 1) Check whether a bucket exists using GetBucketLocation. 2) If it doesn't, create it using CreateBucket. 3) Do operations on the bucket. then 3) will fail for a minute or so with a NoSuchBucket exception, presumably because the server being hit is a fallback for cases when buckets don't exist. Disabling the use of virtual hosts ensures that 3) succeeds immediately. (I don't know what S3's consistency guarantees are for bucket creation, but in practice buckets appear to be available immediately.)
2017-06-19	Support creating S3 caches in other regions than us-east-1	Eelco Dolstra	1	-4/+10