about summary refs log tree commit diff
path: root/src/nix-daemon (follow)
AgeCommit message (Collapse)AuthorFilesLines
2018-05-30 Move some Download-specific settings to download.ccEelco Dolstra1-1/+1
2018-05-30 Make 'nix copy --to daemon' run in constant memory (daemon side)Eelco Dolstra1-3/+13
Continuation of 97002b684c902dadcd351a67208f9c2a88ff8f8f. This makes the daemon use constant memory. For example, it reduces the daemon's maximum RSS on $ nix copy --from ~/my-nix --to daemon /nix/store/1n7x0yv8vq6zi90hfmian84vdhd04bgp-blender-2.79a from 264 MiB to 7 MiB. We now use a TunnelSource to prevent the connection from ending up in an undefined state if an exception is thrown while the NAR is being sent. Issue https://github.com/NixOS/nix/issues/1681.
2018-05-26 nix-daemon: remove unused "pendingMsgs" variableWill Dietz1-2/+0
2018-05-21 serialise: fix buffer size used, hide method for internal use onlyWill Dietz1-1/+2
Fixes #2169.
2018-04-09 nix-daemon: Exit successfully when interrupted.Shea Levy1-1/+1
Fixes #2058.
2018-03-22 Merge branch 'fix/avoid-large-stack-buffers' of https://github.com/dtzWill/nixEelco Dolstra1-3/+3
2018-03-16 Reduce substitution memory consumptionEelco Dolstra1-1/+1
copyStorePath() now pipes the output of srcStore->narFromPath() directly into dstStore->addToStore(). The sink used by the former is converted into a source usable by the latter using boost::coroutine2. This is based on [1]. This reduces the maximum resident size of $ nix build --store ~/my-nix/ /nix/store/b0zlxla7dmy1iwc3g459rjznx59797xy-binutils-2.28.1 --substituters file:///tmp/binary-cache-xz/ --no-require-sigs from 418592 KiB to 53416 KiB. (The previous commit also reduced the runtime from ~4.2s to ~3.4s, not sure why.) A further improvement will be to download files into a Sink. [1] https://github.com/NixOS/nix/compare/master...Mathnerd314:dump-fix-coroutine#diff-dcbcac55a634031f9cc73707da6e4b18 Issue #1969.
2018-03-14 nix-daemon: preserve errno in signal handler (thanks tsan)Will Dietz1-0/+3
2018-03-02 don't allocate large buffers on the stackWill Dietz1-3/+3
2018-02-08 Add plugins to make Nix more extensible.Shea Levy1-0/+2
All plugins in plugin-files will be dlopened, allowing them to statically construct instances of the various Register* types Nix supports.
2018-02-07 More completely fix recursive nix, unbreak testsWill Dietz1-1/+1
See: https://github.com/NixOS/nix/commit/88b5d0c8e89afefbc547b6243c5aa5a3ec8176e9#commitcomment-27406365
2018-02-07 Prevent accidental recursive NixEelco Dolstra1-1/+1
2018-01-08 Improve error message with --repair for untrusted usersEelco Dolstra1-1/+1
2017-10-24 Remove the remote-builds optionEelco Dolstra1-1/+1
This is superfluous since you can now just set "builders" to empty, e.g. "--builders ''".
2017-08-28 Give activities a verbosity level againEelco Dolstra1-3/+8
And print them (separately from the progress bar) given sufficient -v flags.
2017-08-28 Don't send progress messages to older clientsEelco Dolstra1-11/+18
2017-08-28 Tunnel progress messages from the daemon to the clientEelco Dolstra1-18/+62
This makes the progress bar work for non-root users.
2017-08-28 Make TunnelLogger thread-safeEelco Dolstra1-109/+129
Now that we use threads in lots of places, it's possible for TunnelLogger::log() to be called asynchronously from other threads than the main loop. So we need to ensure that STDERR_NEXT messages don't clobber other messages.
2017-08-16 Progress indicator: CleanupEelco Dolstra1-4/+0
2017-07-30 Replace Unicode quotes in user-facing strings by ASCIIJörg Thalheim1-6/+6
Relevant RFC: NixOS/rfcs#4 $ ag -l | xargs sed -i -e "/\"/s/’/'/g;/\"/s/‘/'/g"
2017-07-04 Support base-64 hashesEelco Dolstra1-3/+3
Also simplify the Hash API. Fixes #1437.
2017-07-03 Replace a few bool flags with enumsEelco Dolstra1-4/+6
Functions like copyClosure() had 3 bool arguments, which creates a severe risk of mixing up arguments. Also, implement copyClosure() using copyPaths().
2017-05-16 Improve progress indicatorEelco Dolstra1-6/+1
2017-05-11 Don't allow untrusted users to set info.ultimateEelco Dolstra1-0/+2
Note that a trusted signature was still required in this case so it was not a huge deal.
2017-04-28 Suppress warning about ssh-auth-sockEelco Dolstra1-1/+3
2017-04-20 Setting: Remove "Tag" template argumentEelco Dolstra1-1/+1
2017-04-20 Reimplement trusted-substituters (aka trusted-binary-caches)Eelco Dolstra1-6/+42
2017-04-14 Minor cleanupEelco Dolstra1-2/+2
2017-04-14 nix-daemon: Don't set untrusted-* settingsEelco Dolstra1-3/+1
These are no longer used anywhere.
2017-04-14 nix-daemon: Don't die if the user sends an unknown settingEelco Dolstra1-4/+8
2017-04-13 Convert Settings to the new config systemEelco Dolstra1-7/+6
This makes all config options self-documenting. Unknown or unparseable config settings and --option flags now cause a warning.
2017-04-13 Merge branch 'rework-options' of https://github.com/copumpkin/nixEelco Dolstra1-2/+2
2017-04-06 Implement RemoteStore::queryMissing()Eelco Dolstra1-0/+11
This provides a significant speedup, e.g. 64 s -> 12 s for nix-build --dry-run -I nixpkgs=channel:nixos-16.03 '<nixpkgs/nixos/tests/misc.nix>' -A test on a cold local and CloudFront cache. The alternative is to use lots of concurrent daemon connections but that seems wasteful.
2017-04-06 nix-daemon: Disable path info cacheEelco Dolstra1-1/+4
This is useless because the client also caches path info, and can cause problems for long-running clients like hydra-queue-runner (i.e. it may return cached info about paths that have been garbage-collected).
2017-03-01 TeeSink: Pre-reserve string spaceEelco Dolstra1-4/+3
When receiving a very large file, this can prevent the string from having tobe copied, which temporarily doubles memory consumption.
2017-03-01 RemoteStore::addToStore(): Send NAR rather than string containing NAREelco Dolstra1-7/+10
This allows the NAR to be streamed in the future (though we're not doing that yet).
2017-03-01 Handle importing NARs containing files greater than 4 GiBEelco Dolstra1-18/+14
Also templatize readInt() to work for various integer types.
2017-02-22 Explicitly model all settings and fail on unrecognized onesDan Peebles1-2/+2
Previously, the Settings class allowed other code to query for string properties, which led to a proliferation of code all over the place making up new options without any sort of central registry of valid options. This commit pulls all those options back into the central Settings class and removes the public get() methods, to discourage future abuses like that. Furthermore, because we know the full set of options ahead of time, we now fail loudly if someone enters an unrecognized option, thus preventing subtle typos. With some template fun, we could probably also dump the full set of options (with documentation, defaults, etc.) to the command line, but I'm not doing that yet here.
2017-02-22 RemoteStore::addToStore(): Pass content-addressability assertionEelco Dolstra1-0/+1
... and use this in Downloader::downloadCached(). This fixes $ nix-build https://nixos.org/channels/nixos-16.09-small/nixexprs.tar.xz -A hello error: cannot import path ‘/nix/store/csfbp1s60dkgmk9f8g0zk0mwb7hzgabd-nixexprs.tar.xz’ because it lacks a valid signature
2017-02-13 nix-daemon: Don't splice with len=SIZE_MAXTuomas Tynkkynen1-2/+3
Currently, 'nix-daemon --stdio' is always failing for me, due to the splice call always failing with (on a 32-bit host): splice(0, NULL, 3, NULL, 4294967295, SPLICE_F_MOVE) = -1 EINVAL (Invalid argument) With a bit of ftracing (and luck) the problem seems to be that splice() always fails with EINVAL if the len cast as ssize_t is negative: http://lxr.free-electrons.com/source/fs/read_write.c?v=4.4#L384 So use SSIZE_MAX instead of SIZE_MAX.
2017-02-07 Move SavingSourceAdapter to serialise.hhEelco Dolstra1-15/+0
2016-11-26 Revert "Get rid of unicode quotes (#1140)"Eelco Dolstra1-6/+6
This reverts commit f78126bfd6b6c8477fcdbc09b2f98772dbe9a1e7. There really is no need for such a massive change...
2016-11-25 Get rid of unicode quotes (#1140)Guillaume Maudoux1-6/+6
2016-11-17 nix-daemon: Fix splice faking on non-LinuxShea Levy1-2/+2
2016-11-09 Merge branch 'ssh-store' of https://github.com/shlevy/nixEelco Dolstra1-1/+106
2016-11-09 Implement backwards-compatible RemoteStore::addToStore()Eelco Dolstra1-1/+1
The SSHStore PR adds this functionality to the daemon, but we have to handle the case where the Nix daemon is 1.11. Also, don't require signatures for trusted users. This restores 1.11 behaviour. Fixes https://github.com/NixOS/hydra/issues/398.
2016-10-21 Remove addPathToAccessorEelco Dolstra1-1/+1
2016-09-21 printMsg(lvlError, ...) -> printError(...) etc.Eelco Dolstra1-3/+3
2016-09-12 nix-daemon: Fix error messageShea Levy1-1/+1
2016-09-02 Implement nar-based addToStore for remote-storeShea Levy1-0/+23
generated by cgit-pink 1.4.1 (git 2.44.2) at 2024-07-27T23·23+0000