depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2017-03-21	Move istringstream_nocopy to a separate file	Eelco Dolstra	2	-1/+2

2017-03-21	Honor $NIX_SSHOPTS again	Eelco Dolstra	2	-9/+14
	NixOps needs this.
2017-03-20	Merge branch 'darwin-s3-binary-cache-store' of https://github.com/shlevy/nix	Eelco Dolstra	2	-14/+1

2017-03-16	ssh:// -> ssh-ng://, legacy-ssh:// -> ssh://	Eelco Dolstra	2	-2/+2

2017-03-16	copyPaths(): Use queryValidPaths() to reduce SSH latency	Eelco Dolstra	7	-30/+34

2017-03-16	copyPaths(): Don't query path info for a path the target already has	Eelco Dolstra	1	-0/+1
	For example, this cuts "nix-copy-closure --from" on a NixOS system closure from 15.9s to 0.5s.
2017-03-16	LegacySSHStore: Provide a faster implementation of computeFSClosure()	Eelco Dolstra	2	-1/+23
	This avoids the latency of the standard implementation, which can make a huge difference (e.g. 16.5s -> 0.5s on a NixOS system closure).
2017-03-16	Fix nix-copy-closure --to	Eelco Dolstra	1	-1/+1

2017-03-16	Remove "killing process <pid>" messages	Eelco Dolstra	1	-2/+2
	They convey no useful information.
2017-03-15	More precise compression settings	Eelco Dolstra	1	-5/+8

2017-03-15	runProgram(): Distinguish between empty input and no input	Eelco Dolstra	1	-1/+1
	For example, if we call brotli with an empty input, it shouldn't read from the caller's stdin.
2017-03-15	Compress NAR listings using the "text-compression" method	Eelco Dolstra	2	-3/+3
	So if "text-compression=br", the .ls file in S3 will get a Content-Encoding of "br". Brotli appears to compress better than xz for this kind of file and is natively supported by browsers.
2017-03-15	S3BinaryCacheStore: Set Content-Type	Eelco Dolstra	5	-13/+25
	This is necessary for serving log files to browsers.
2017-03-15	S3BinaryCacheStore: Support compression of narinfo and log files	Eelco Dolstra	4	-8/+40
	You can now set the store parameter "text-compression=br" to compress textual files in the binary cache (i.e. narinfo and logs) using Brotli. This sets the Content-Encoding header; the extension of compressed files is unchanged. You can separately specify the compression of log files using "log-compression=br". This is useful when you don't want to compress narinfo files for backward compatibility.
2017-03-15	Add support for brotli compression	Eelco Dolstra	1	-2/+19
	Build logs on cache.nixos.org are compressed using Brotli (since this allows them to be decompressed automatically by Chrome and Firefox), so it's handy if "nix log" can decompress them.
2017-03-15	BinaryCacheStore: Implement getBuildLog()	Eelco Dolstra	3	-1/+31
	We assume that build logs are stored under log/<drv>, e.g. /nix/store/q7ab198v13p0f8x8wgnd75dva7d5mip6-friday-devil-0.1.1.1.drv maps to https://cache.nixos.org/log/q7ab198v13p0f8x8wgnd75dva7d5mip6-friday-devil-0.1.1.1.drv
2017-03-15	Store: Add a method for getting build logs	Eelco Dolstra	6	-11/+44
	This allows various Store implementations to provide different ways to get build logs. For example, BinaryCacheStore can get the build logs from the binary cache. Also, remove the log-servers option since we can use substituters for this.
2017-03-12	Merge branch 'configurable-aws-region'	Shea Levy	3	-7/+11

2017-03-08	Add option to disable import-from-derivation completely, even if the drv is ↵	Shea Levy	2	-0/+5
	already realized
2017-03-06	Properly set the caFile for aws-sdk-cpp s3	Shea Levy	4	-2/+6

2017-03-06	istringstream_nocopy: Implement in a standards-compliant way.	Shea Levy	2	-14/+1
	Fixes the problem mentioned in e6a61b8da788efbbbb0eb690c49434b6b5fc9741 See #1135
2017-03-03	Add aws-region param to S3 store URLs	Shea Levy	3	-7/+11

2017-03-03	Cache connection failures	Eelco Dolstra	2	-1/+18

2017-03-03	SSHMaster: Make thread-safe	Eelco Dolstra	2	-17/+29

2017-03-03	build-remote: Don't use a SSH master	Eelco Dolstra	2	-0/+6
	This is unnecessary because we make only one connection.
2017-03-03	Improve SSH handling	Eelco Dolstra	6	-112/+179
	* Unify SSH code in SSHStore and LegacySSHStore. * Fix a race starting the SSH master. We now wait synchronously for the SSH master to finish starting. This prevents the SSH clients from starting their own connections. * Don't use a master if max-connections == 1. * Add a "max-connections" store parameter. * Add a "compress" store parameter.
2017-03-03	Fix fatal "broken pipe" error when $NIX_BUILD_HOOK is missing	Eelco Dolstra	1	-27/+39

2017-03-01	TeeSink: Pre-reserve string space	Eelco Dolstra	1	-6/+5
	When receiving a very large file, this can prevent the string from having tobe copied, which temporarily doubles memory consumption.
2017-03-01	RemoteStore::addToStore(): Send NAR rather than string containing NAR	Eelco Dolstra	3	-26/+6
	This allows the NAR to be streamed in the future (though we're not doing that yet).
2017-03-01	Tweak message	Eelco Dolstra	1	-1/+1

2017-03-01	Handle importing NARs containing files greater than 4 GiB	Eelco Dolstra	3	-18/+16
	Also templatize readInt() to work for various integer types.
2017-02-28	Fix building against older curl versions	Eelco Dolstra	1	-1/+4
	http://hydra.nixos.org/build/49490928
2017-02-28	Improve SQLite busy handling	Eelco Dolstra	2	-30/+42

2017-02-28	NarInfoDiskCache: Handle SQLite busy errors	Eelco Dolstra	1	-104/+115

2017-02-28	In SQLite errors, include the database path	Eelco Dolstra	1	-4/+8
	This is necessary because we have multiple SQLite databases (e.g. the binary cache cache).
2017-02-28	Support auto-configuration of build-max-jobs	Eelco Dolstra	1	-1/+8
	"build-max-jobs" and the "-j" option can now be set to "auto" to use the number of CPUs in the system. (Unlike build-cores, it doesn't use 0 to imply auto-configuration, because a) magic values are a bad idea in general; b) 0 is a legitimate value used to disable local building.) Fixes #1198.
2017-02-27	_SC_NPROCESSORS_ONLN -> std::thread::hardware_concurrency()	Eelco Dolstra	1	-7/+3

2017-02-27	Retry downloads on HTTP/2 stream errors	Eelco Dolstra	1	-1/+3
	Issue #1254.
2017-02-24	Register content-addressability assertion for fixed outputs	Eelco Dolstra	1	-1/+4

2017-02-24	Verify content-addressability assertions at registration time	Eelco Dolstra	1	-0/+2

2017-02-22	RemoteStore::addToStore(): Pass content-addressability assertion	Eelco Dolstra	5	-3/+15
	... and use this in Downloader::downloadCached(). This fixes $ nix-build https://nixos.org/channels/nixos-16.09-small/nixexprs.tar.xz -A hello error: cannot import path ‘/nix/store/csfbp1s60dkgmk9f8g0zk0mwb7hzgabd-nixexprs.tar.xz’ because it lacks a valid signature
2017-02-21	Handle CURLE_RECV_ERROR as a transient error	Eelco Dolstra	1	-1/+1
	This fixes unable to download ‘https://cache.nixos.org/nar/077h8ji74y9b0qx7rjk71xd80vjqp6q5gy137r553jlvdlxdcdlk.nar.xz’: HTTP error 200 (curl error: Failure when receiving data from the peer)
2017-02-21	Fix building without S3 support	Eelco Dolstra	2	-2/+2
	http://hydra.nixos.org/build/49031196/nixlog/2/raw
2017-02-21	Log AWS retries	Eelco Dolstra	1	-0/+14

2017-02-16	Support netrc in <nix/fetchurl.nix>	Eelco Dolstra	3	-4/+22
	This allows <nix/fetchurl.nix> to fetch private Git/Mercurial repositories, e.g. import <nix/fetchurl.nix> { url = https://edolstra@bitbucket.org/edolstra/my-private-repo/get/80a14018daed.tar.bz2; sha256 = "1mgqzn7biqkq3hf2697b0jc4wabkqhmzq2srdymjfa6sb9zb6qs7"; } where /etc/nix/netrc contains: machine bitbucket.org login edolstra password blabla... This works even when sandboxing is enabled. To do: add unpacking support (i.e. fetchzip functionality).
2017-02-16	Move netrcFile to Settings	Eelco Dolstra	3	-26/+23
	Also get rid of Settings::processEnvironment(), it appears to be useless.
2017-02-16	Include "curl" in the User-Agent header	Eelco Dolstra	1	-1/+1
	Some sites (e.g. BitBucket) give a helpful 401 error when trying to download a private archive if the User-Agent contains "curl", but give a redirect to a login page otherwise (so for instance "nix-prefetch-url" will succeed but produce useless output).
2017-02-16	Merge pull request #1215 from k0001/netrc-1	Eelco Dolstra	1	-0/+8
	Add netrc-file support
2017-02-14	Add support for s3:// URIs	Eelco Dolstra	4	-63/+141
	This adds support for s3:// URIs in all places where Nix allows URIs, e.g. in builtins.fetchurl, builtins.fetchTarball, <nix/fetchurl.nix> and NIX_PATH. It allows fetching resources from private S3 buckets, using credentials obtained from the standard places (i.e. AWS_* environment variables, ~/.aws/credentials and the EC2 metadata server). This may not be super-useful in general, but since we already depend on aws-sdk-cpp, it's a cheap feature to add.
2017-02-09	Documentation.	Renzo Carbonara	1	-0/+3