depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2018-03-22	Fix build	Eelco Dolstra	1	-2/+2

2018-03-22	Tweak	Eelco Dolstra	1	-1/+1

2018-03-22	Merge branch 'fix/avoid-large-stack-buffers' of https://github.com/dtzWill/nix	Eelco Dolstra	3	-20/+21

2018-03-21	Make 'nix copy --from ssh://...' run in constant memory	Eelco Dolstra	2	-0/+20
	For instance, this reduced the memory consumption of $ nix copy --from ssh://localhost --to ~/my-nix /nix/store/1n7x0yv8vq6zi90hfmian84vdhd04bgp-blender-2.79a from 632 MiB to 16 MiB.
2018-03-20	Hack to get SSH error messages from build-remote	Eelco Dolstra	2	-5/+22
	E.g. cannot build on 'ssh://mac1': cannot connect to 'mac1': bash: nix-store: command not found cannot build on 'ssh://mac2': cannot connect to 'mac2': Host key verification failed. cannot build on 'ssh://mac3': cannot connect to 'mac3': Received disconnect from 213... port 6001:2: Too many authentication failures Authentication failed.
2018-03-19	serialise.cc: remove pessimising move	Will Dietz	1	-1/+1
	from clang6: src/libutil/serialise.cc:189:23: warning: moving a temporary object prevents copy elision [-Wpessimizing-move]
2018-03-19	util: rename stdout/stdin members to avoid conflicts w/standard macro	Will Dietz	2	-9/+9
	(cherry picked from commit c389a7fb617ed7bcd617efa68c6a48c00405310d)
2018-03-16	Reduce substitution memory consumption	Eelco Dolstra	3	-1/+87
	copyStorePath() now pipes the output of srcStore->narFromPath() directly into dstStore->addToStore(). The sink used by the former is converted into a source usable by the latter using boost::coroutine2. This is based on [1]. This reduces the maximum resident size of $ nix build --store ~/my-nix/ /nix/store/b0zlxla7dmy1iwc3g459rjznx59797xy-binutils-2.28.1 --substituters file:///tmp/binary-cache-xz/ --no-require-sigs from 418592 KiB to 53416 KiB. (The previous commit also reduced the runtime from ~4.2s to ~3.4s, not sure why.) A further improvement will be to download files into a Sink. [1] https://github.com/NixOS/nix/compare/master...Mathnerd314:dump-fix-coroutine#diff-dcbcac55a634031f9cc73707da6e4b18 Issue #1969.
2018-03-16	decompress(): Use a Source and Sink	Eelco Dolstra	5	-75/+198
	This allows decompression to happen in O(1) memory.
2018-03-15	Filter ANSI colors when not writing to a terminal	Eelco Dolstra	3	-7/+9
	Fixes https://github.com/NixOS/nixpkgs/issues/37114.
2018-03-15	Merge pull request #1965 from masaeedu/master	Eelco Dolstra	2	-6/+16
	Wrap thread local in function for Cygwin
2018-03-14	Catch more possible instances of passing NULL to memcpy.	Shea Levy	1	-0/+1
	Actually fixes #1976.
2018-03-12	Wrap thread local in function for Cygwin	Asad Saeeduddin	2	-6/+16
	Fixes #1826. See #1352 for a previous instance of a similar change.
2018-03-09	Fix double free in Store::queryPathInfo()	Eelco Dolstra	1	-4/+4
	It was holding on to a Value* (i.e. a std::shared_ptr<ValidPathInfo>) outside of the pathInfoCache lock, so the std::shared_ptr could be destroyed between the release of the lock and the decrement of the std::shared_ptr refcount. This can happen if more than 'path-info-cache-size' paths are added in the meantime, or* if clearPathInfoCache() is called. The hydra-queue-runner queue monitor thread periodically calls the later, so is likely to trigger a crash. Fixes https://github.com/NixOS/hydra/issues/542.
2018-03-06	logging: Don't throw from Activity destructor	Will Dietz	2	-2/+9
	Move definition of destructor to logging.cc for access to util.hh's ignoreException.
2018-03-02	don't allocate large buffers on the stack	Will Dietz	3	-23/+24

2018-03-02	Merge branch 'write-failure-fixes' of git://github.com/lheckemann/nix	Shea Levy	1	-1/+2

2018-02-26	nix run: Fix segfault on macOS	Eelco Dolstra	2	-0/+10
	Note that clearenv() is not available on macOS. Fixes #1907.
2018-02-19	libutil: Fix invalid assert on decoding base64 hashes	Tuomas Tynkkynen	1	-1/+2
	The assertion is broken because there is no one-to-one mapping from length of a base64 string to the length of the output. E.g. "1q69lz7Empb06nzfkj651413n9icx0njmyr3xzq1j9q=" results in a 32-byte output. "1q69lz7Empb06nzfkj651413n9icx0njmyr3xzq1j9qy" results in a 33-byte output. To reproduce, evaluate: builtins.derivationStrict { name = "0"; builder = "0"; system = "0"; outputHashAlgo = "sha256"; outputHash = "1q69lz7Empb06nzfkj651413n9icx0njmyr3xzq1j9qy"; } Found by afl-fuzz.
2018-02-19	libutil: Fix infinite loop in filterANSIEscapes on '\r'	Tuomas Tynkkynen	1	-1/+1
	E.g. nix-instantiate --eval -E 'abort "\r"' hangs. Found by afl-fuzz.
2018-02-19	Config::handleUnknownSettings(): Remove unused 'fatal' argument	Eelco Dolstra	2	-6/+3

2018-02-19	Merge branch 'register-settings' of https://github.com/shlevy/nix	Eelco Dolstra	2	-25/+25

2018-02-19	Merge pull request #1857 from dtzWill/fix/check-for-lzma-mt	Eelco Dolstra	1	-23/+37
	configure.ac: check if lzma has MT support, fix deb build/etc.
2018-02-14	monitor-fds: Fix on macOS.	Shea Levy	1	-7/+23
	Fixes #1871.
2018-02-13	Allow plugins to define new settings.	Shea Levy	2	-25/+25

2018-02-13	Fix #1762	Linus Heckemann	1	-1/+2
	nix-store --export, nix-store --dump, and nix dump-path would previously fail silently if writing the data out failed, because a) FdSink::write ignored exceptions, and b) the commands relied on FdSink's destructor, which ignores exceptions, to flush the data out. This could cause rather opaque issues with installing nixos, because nix-store --export would happily proceed even if it couldn't write its data out (e.g. if nix-store --import on the other side of the pipe failed). This commit adds tests that expose these issues in the nix-store commands, and fixes them for all three.
2018-02-13	Allow includes from nix.conf	Shea Levy	1	-1/+25

2018-02-11	compression: make parallel sink separate class	Will Dietz	1	-29/+34

2018-02-11	compression: print warning if parallel requested but not supported	Will Dietz	1	-1/+8

2018-02-09	configure.ac: check if lzma has MT support, fix deb build/etc.	Will Dietz	1	-0/+2

2018-02-07	make multi threaded compression configurable and use single threaded	AmineChikhaoui	2	-19/+27
	by default.
2018-02-07	Merge branch 'master' of https://github.com/NixOS/nix into parallel-xz	AmineChikhaoui	3	-31/+48

2018-02-07	Improve filtering of ANSI escape sequences in build logs	Eelco Dolstra	3	-31/+48
	All ANSI sequences except color setting are now filtered out. In particular, terminal resets (such as from NixOS VM tests) are filtered out. Also, fix the completely broken tab character handling.
2018-02-07	set block size to 0 to let the lzma lib choose the right one, add	AmineChikhaoui	1	-1/+6
	some comments about possible improvements wrt memory usage/threading.
2018-02-06	support multi threaded xz encoder, this might be particularly useful in	AmineChikhaoui	1	-2/+7
	the case of hydra where the overhead of single threaded encoding is more noticeable e.g most of the time spent in "Sending inputs"/"Receiving outputs" is due to compression while the actual upload to the binary cache seems to be negligible.
2018-01-16	Add pure evaluation mode	Eelco Dolstra	2	-2/+10
	In this mode, the following restrictions apply: * The builtins currentTime, currentSystem and storePath throw an error. * $NIX_PATH and -I are ignored. * fetchGit and fetchMercurial require a revision hash. * fetchurl and fetchTarball require a sha256 attribute. * No file system access is allowed outside of the paths returned by fetch{Git,Mercurial,url,Tarball}. Thus 'nix build -f ./foo.nix' is not allowed. Thus, the evaluation result is completely reproducible from the command line arguments. E.g. nix build --pure-eval '( let nix = fetchGit { url = https://github.com/NixOS/nixpkgs.git; rev = "9c927de4b179a6dd210dd88d34bda8af4b575680"; }; nixpkgs = fetchGit { url = https://github.com/NixOS/nixpkgs.git; ref = "release-17.09"; rev = "66b4de79e3841530e6d9c6baf98702aa1f7124e4"; }; in (import (nix + "/release.nix") { inherit nix nixpkgs; }).build.x86_64-linux )' The goal is to enable completely reproducible and traceable evaluation. For example, a NixOS configuration could be fully described by a single Git commit hash. 'nixos-rebuild' would do something like nix build --pure-eval '( (import (fetchGit { url = file:///my-nixos-config; rev = "..."; })).system ') where the Git repository /my-nixos-config would use further fetchGit calls or Git externals to fetch Nixpkgs and whatever other dependencies it has. Either way, the commit hash would uniquely identify the NixOS configuration and allow it to reproduced.
2017-12-30	use libbrotli directly when available	Will Dietz	2	-10/+165
	* Look for both 'brotli' and 'bro' as external command, since upstream has renamed it in newer versions. If neither are found, current runtime behavior is preserved: try to find 'bro' on PATH. * Limit amount handed to BrotliEncoderCompressStream to ensure interrupts are processed in a timely manner. Testing shows negligible performance impact. (Other compression sinks don't seem to require this)
2017-12-11	logging.cc: add missing 'override'	Will Dietz	1	-0/+1

2017-11-21	Propagate flags like --sandbox to the daemon properly	Eelco Dolstra	2	-3/+9

2017-11-20	Cleanup	Eelco Dolstra	1	-2/+2

2017-11-20	Merge pull request #1645 from twhitehead/stat-race	Eelco Dolstra	1	-12/+11
	Fix (highly unlikely) race condition in readLink
2017-11-01	fetchMercurial: Don't fetch hashes we already have	Eelco Dolstra	2	-15/+43

2017-10-30	builtins.fetchgit: Support importing a working tree	Eelco Dolstra	4	-10/+7
	For example, you can write src = fetchgit ./.; and if ./. refers to an unclean working tree, that tree will be copied to the Nix store. This removes the need for "cleanSource".
2017-10-30	Fix (highly unlikely) race condition in readLink	Tyson Whitehead	1	-12/+11
	Used to determine symlink size with stat and value with readlink. This could technically result in garbage if symlink changed between calls. Also gets around the broken stat implementation in our network filesystem (returns size + 1 giving a byte of garbage).
2017-10-25	Pass lists/attrsets to bash as (associative) arrays	Eelco Dolstra	2	-4/+12

2017-10-24	More progress indicator improvements	Eelco Dolstra	2	-3/+4
	Fixes #1599.
2017-10-24	Handle log messages from build-remote	Eelco Dolstra	2	-0/+135
	This makes the progress indicator show statuses like "connecting to 'root@machine'".
2017-10-24	nix: Respect -I, --arg, --argstr	Eelco Dolstra	3	-48/+44
	Also, random cleanup to argument handling.
2017-10-23	Pass all settings to build-remote	Eelco Dolstra	1	-1/+21
	This ensures that command line flags such as --builders get passed correctly.
2017-10-09	Fix a hang in ThreadPool	Eelco Dolstra	2	-33/+57
	The worker threads could exit prematurely if they finished processing all items while the main thread was still adding items. In particular, this caused hanging nix-store --serve processes in the build farm. Also, process items from the main thread.