depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2016-10-21	BinaryCacheStore: Optionally write a NAR listing	Eelco Dolstra	1	-1/+1
	The store parameter "write-nar-listing=1" will cause BinaryCacheStore to write a file ‘<store-hash>.ls.xz’ for each ‘<store-hash>.narinfo’ added to the binary cache. This file contains an XZ-compressed JSON file describing the contents of the NAR, excluding the contents of regular files. E.g. { "version": 1, "root": { "type": "directory", "entries": { "lib": { "type": "directory", "entries": { "Mcrt1.o": { "type": "regular", "size": 1288 }, "Scrt1.o": { "type": "regular", "size": 3920 }, } } } ... } } (The actual file has no indentation.) This is intended to speed up the NixOS channels programs index generator [1], since fetching gazillions of large NARs from cache.nixos.org is currently a bottleneck for updating the regular (non-small) channel. [1] https://github.com/NixOS/nixos-channel-scripts/blob/master/generate-programs-index.cc
2016-10-19	Merge branch 'priorityqueue' of https://github.com/groxxda/nix	Eelco Dolstra	1	-12/+17

2016-10-19	Fix uninitialised variable	Eelco Dolstra	1	-1/+1

2016-10-18	downloader: use priority_queue	Alexander Ried	1	-12/+17

2016-10-14	CURL_AT_LEAST_VERSION -> LIBCURL_VERSION_NUM	Eelco Dolstra	1	-4/+3
	http://hydra.nixos.org/build/42025230
2016-10-13	Fix HTTP/2 support	Eelco Dolstra	1	-3/+3
	Commit 86e8c67efc33cf756500a1dec7fd6313658f2664 broke it, because CURL_* are not actually #defines.
2016-10-13	SSL_CERT_FILE -> NIX_SSL_CERT_FILE	Eelco Dolstra	1	-1/+2
	This prevents collisions with the "native" OpenSSL, in particular on OS X. Fixes #921.
2016-10-05	Use std::random_device	Eelco Dolstra	1	-0/+1

2016-10-04	Fix build with older versions of libcurl	Eelco Dolstra	1	-0/+6

2016-09-21	printMsg(lvlError, ...) -> printError(...) etc.	Eelco Dolstra	1	-5/+5

2016-09-20	Tweak	Eelco Dolstra	1	-5/+1

2016-09-20	Improve robustness	Eelco Dolstra	1	-2/+6

2016-09-16	Make computeFSClosure() single-threaded again	Eelco Dolstra	1	-11/+27
	The fact that queryPathInfo() is synchronous meant that we needed a thread for every concurrent binary cache lookup, even though they end up being handled by the same download thread. Requiring hundreds of threads is not a good idea. So now there is an asynchronous version of queryPathInfo() that takes a callback function to process the result. Similarly, enqueueDownload() now takes a callback rather than returning a future. Thus, a command like nix path-info --store https://cache.nixos.org/ -r /nix/store/slljrzwmpygy1daay14kjszsr9xix063-nixos-16.09beta231.dccf8c5 that returns 4941 paths now takes 1.87s using only 2 threads (the main thread and the downloader thread). (This is with a prewarmed CloudFront.)
2016-09-14	Revive binary-caches-parallel-connections	Eelco Dolstra	1	-2/+8
	It's a slight misnomer now because it actually limits all downloads, not just binary cache lookups. Also add a "enable-http2" option to allow disabling use of HTTP/2 (enabled by default).
2016-09-14	Enable HTTP/2 support	Eelco Dolstra	1	-171/+379
	The binary cache store can now use HTTP/2 to do lookups. This is much more efficient than HTTP/1.1 due to multiplexing: we can issue many requests in parallel over a single TCP connection. Thus it's no longer necessary to use a bunch of concurrent TCP connections (25 by default). For example, downloading 802 .narinfo files from https://cache.nixos.org/, using a single TCP connection, takes 11.8s with HTTP/1.1, but only 0.61s with HTTP/2. This did require a fairly substantial rewrite of the Downloader class to use the curl multi interface, because otherwise curl wouldn't be able to do multiplexing for us. As a bonus, we get connection reuse even with HTTP/1.1. All downloads are now handled by a single worker thread. Clients call Downloader::enqueueDownload() to tell the worker thread to start the download, getting a std::future to the result.
2016-08-31	download.hh: Fix conflicts from nix-channel-c++ merge	Shea Levy	1	-9/+5

2016-08-31	Merge branch 'nix-channel-c++'	Shea Levy	1	-3/+17

2016-08-30	Increase the sleep time between download retries	Eelco Dolstra	1	-1/+1

2016-08-15	builtins.fetch{url,tarball}: Allow name attribute	Shea Levy	1	-4/+5

2016-08-11	nix-channel: implement in c++	Shea Levy	1	-3/+17

2016-08-10	HttpBinaryCacheStore: Retry on transient HTTP errors	Eelco Dolstra	1	-9/+26
	This makes us more robust against 500 errors from CloudFront or S3 (assuming the 500 error isn't cached by CloudFront...).
2016-08-10	Show HTTP error codes	Eelco Dolstra	1	-2/+6

2016-07-26	makeFixedOutputPath(): Drop superfluous HashType argument	Eelco Dolstra	1	-2/+2

2016-07-26	builtins.{fetchurl,fetchTarball}: Support a sha256 attribute	Eelco Dolstra	1	-8/+27
	Also, allow builtins.{fetchurl,fetchTarball} in restricted mode if a hash is specified.
2016-07-21	Fix random failures caused by CurlDownloader modifying a shared string	Eelco Dolstra	1	-1/+1

2016-04-29	Add fetchgit builtin	Eelco Dolstra	1	-1/+1
	The function builtins.fetchgit fetches Git repositories at evaluation time, similar to builtins.fetchTarball. (Perhaps the name should be changed, being confusing with respect to Nixpkgs's fetchgit function, with works at build time.) Example: (import (builtins.fetchgit git://github.com/NixOS/nixpkgs) {}).hello or (import (builtins.fetchgit { url = git://github.com/NixOS/nixpkgs-channels; rev = "nixos-16.03"; }) {}).hello Note that the result does not contain a .git directory.
2016-04-20	Cache path info lookups in SQLite	Eelco Dolstra	1	-1/+1
	This re-implements the binary cache database in C++, allowing it to be used by other Store backends, in particular the S3 backend.
2016-04-15	BinaryCacheStore::readFile(): Return a shared_ptr to a string	Eelco Dolstra	1	-4/+5
	This allows readFile() to indicate that a file doesn't exist, and might eliminate some large string copying.
2016-04-14	Support channel:<channel-name> URIs	Eelco Dolstra	1	-5/+14
	For convenience, you can now say $ nix-env -f channel:nixos-16.03 -iA hello instead of $ nix-env -f https://nixos.org/channels/nixos-16.03/nixexprs.tar.xz -iA hello Similarly, $ nix-shell -I channel:nixpkgs-unstable -p hello $ nix-build channel:nixos-15.09 -A hello Abstracting over the NixOS/Nixpkgs channels location also allows us to use a more efficient transport (e.g. Git) in the future.
2016-04-06	Fix "tar: This does not look like a tar archive" with fetchTarball / -I http://	Eelco Dolstra	1	-2/+1
	The 304 Not Modified was not handled correctly, so the empty result from the conditional request would overwrite the previous tarball.
2016-03-30	CurlDownloader: Fix HTTP error processing	Eelco Dolstra	1	-1/+0

2016-02-29	Add an HTTP binary cache store	Eelco Dolstra	1	-49/+75
	Allowing stuff like NIX_REMOTE=https://cache.nixos.org nix-store -qR /nix/store/x1p1gl3a4kkz5ci0nfbayjqlqmczp1kq-geeqie-1.1 or NIX_REMOTE=https://cache.nixos.org nix-store --export /nix/store/x1p1gl3a4kkz5ci0nfbayjqlqmczp1kq-geeqie-1.1 \| nix-store --import
2016-02-22	curl: Set CURLOPT_NOSIGNAL	Eelco Dolstra	1	-0/+2
	Otherwise using curl is not safe in multi-threaded applications because it installs a SIGALRM handler.
2016-02-04	StoreAPI -> Store	Eelco Dolstra	1	-1/+1
	Calling a class an API is a bit redundant...
2016-02-04	Eliminate the "store" global variable	Eelco Dolstra	1	-1/+1
	Also, move a few free-standing functions into StoreAPI and Derivation. Also, introduce a non-nullable smart pointer, ref<T>, which is just a wrapper around std::shared_ptr ensuring that the pointer is never null. (For reference-counted values, this is better than passing a "T&", because the latter doesn't maintain the refcount. Usually, the caller will have a shared_ptr keeping the value alive, but that's not always the case, e.g., when passing a reference to a std::thread via std::bind.)
2015-10-29	int2String() -> std::to_string()	Eelco Dolstra	1	-1/+1

2015-10-21	Show progress indicator for builtin fetchurl	Eelco Dolstra	1	-2/+2

2015-10-21	Disable TLS verification for builtin fetchurl	Eelco Dolstra	1	-9/+17
	This makes it consistent with the Nixpkgs fetchurl and makes it work in chroots. We don't need verification because the hash of the result is checked anyway.
2015-10-08	Revert to CURLOPT_PROGRESSFUNCTION	Eelco Dolstra	1	-5/+5
	CURLOPT_XFERINFOFUNCTION isn't widely supported yet. http://hydra.nixos.org/build/26679495
2015-10-07	Show progress during downloads	Eelco Dolstra	1	-7/+47

2015-07-20	Make <nix/fetchurl.nix> a builtin builder	Eelco Dolstra	1	-0/+236
	This ensures that 1) the derivation doesn't change when Nix changes; 2) the derivation closure doesn't contain Nix and its dependencies; 3) we don't have to rely on ugly chroot hacks.