about summary refs log tree commit diff
path: root/src/libstore/binary-cache-store.cc
AgeCommit message (Collapse)AuthorFilesLines
2016-10-07 importPaths(): Fix accessor support for HydraEelco Dolstra1-0/+8
2016-09-16 Make computeFSClosure() single-threaded againEelco Dolstra1-6/+26
The fact that queryPathInfo() is synchronous meant that we needed a thread for every concurrent binary cache lookup, even though they end up being handled by the same download thread. Requiring hundreds of threads is not a good idea. So now there is an asynchronous version of queryPathInfo() that takes a callback function to process the result. Similarly, enqueueDownload() now takes a callback rather than returning a future. Thus, a command like nix path-info --store https://cache.nixos.org/ -r /nix/store/slljrzwmpygy1daay14kjszsr9xix063-nixos-16.09beta231.dccf8c5 that returns 4941 paths now takes 1.87s using only 2 threads (the main thread and the downloader thread). (This is with a prewarmed CloudFront.)
2016-08-10 FSAccessor: Throw InvalidPathEelco Dolstra1-1/+1
2016-07-26 makeFixedOutputPath(): Drop superfluous HashType argumentEelco Dolstra1-1/+1
2016-06-01 Make the store directory a member variable of StoreEelco Dolstra1-7/+8
2016-05-31 nix-copy-closure / build-remote.pl: Disable signature checkingEelco Dolstra1-1/+2
This restores the Nix 1.11 behaviour.
2016-05-30 Re-implement the WantMassQuery property of binary cachesEelco Dolstra1-1/+20
2016-05-30 BinaryCacheStore: Remove buildPaths() / ensurePath()Eelco Dolstra1-61/+2
2016-05-04 Add a Store::addToStore() variant that accepts a NAREelco Dolstra1-91/+14
As a side effect, this ensures that signatures are propagated when copying paths between stores. Also refactored import/export to make use of this.
2016-05-04 Remove OpenSSL-based signingEelco Dolstra1-6/+3
2016-04-29 BinaryCacheStore: Support bzip2 compressionEelco Dolstra1-1/+4
2016-04-29 Better error messageEelco Dolstra1-1/+6
2016-04-29 BinaryCacheStore: Support "none" compression methodEelco Dolstra1-23/+18
2016-04-29 BinaryCacheStore: Make the signing key a parameterEelco Dolstra1-1/+2
2016-04-29 BinaryCacheStore::queryPathInfo: Don't check signaturesEelco Dolstra1-9/+1
Other stores don't do this either. It's up to the caller to check signatures.
2016-04-28 Fix error messageEelco Dolstra1-1/+1
2016-04-22 BinaryCacheStore: When adding a path, ensure the references are validEelco Dolstra1-0/+11
This prevents copying a partial closure to a binary cache.
2016-04-21 Implement S3BinaryCacheStore::queryAllValidPaths()Eelco Dolstra1-4/+4
This allows commands like "nix verify --all" or "nix path-info --all" to work on S3 caches. Unfortunately, this requires some ugly hackery: when querying the contents of the bucket, we don't want to have to read every .narinfo file. But the S3 bucket keys only include the hash part of each store path, not the name part. So as a special exception queryAllValidPaths() can now return store paths *without* the name part, and queryPathInfo() accepts such store paths (returning a ValidPathInfo object containing the full name).
2016-04-20 BinaryCacheStore: Insert new paths into the disk cacheEelco Dolstra1-0/+4
2016-04-20 Cache path info lookups in SQLiteEelco Dolstra1-2/+1
This re-implements the binary cache database in C++, allowing it to be used by other Store backends, in particular the S3 backend.
2016-04-19 Move path info caching from BinaryCacheStore to StoreEelco Dolstra1-80/+38
Caching path info is generally useful. For instance, it speeds up "nix path-info -rS /run/current-system" (i.e. showing the closure sizes of all paths in the closure of the current system) from 5.6s to 0.15s. This also eliminates some APIs like Store::queryDeriver() and Store::queryReferences().
2016-04-15 BinaryCacheStore: Do negative caching of .narinfo lookupsEelco Dolstra1-2/+10
2016-04-15 BinaryCacheStore::readFile(): Return a shared_ptr to a stringEelco Dolstra1-7/+12
This allows readFile() to indicate that a file doesn't exist, and might eliminate some large string copying.
2016-03-22 Don't overload dumpPath()Eelco Dolstra1-3/+3
2016-03-21 Move signatures from NarInfo to ValidPathInfoEelco Dolstra1-2/+2
This allows queryPathInfo() to return signatures.
2016-03-21 Add Store::dumpPath() methodEelco Dolstra1-4/+11
This allows applying nix-store --verify-path to binary cache stores: NIX_REMOTE=https://cache.nixos.org nix-store --verify-path /nix/store/s5c7...
2016-03-14 BinaryCacheStore::isValidPath(): Use .narinfo cacheEelco Dolstra1-0/+9
If a path is in the .narinfo cache, obviously it's valid.
2016-03-04 BinaryCacheStore: Remove publicKeyFile argumentEelco Dolstra1-6/+3
The public key can be derived from the secret key, so there's no need for the user to supply it separately.
2016-03-04 Eliminate some large string copyingEelco Dolstra1-13/+13
2016-02-26 importPaths(): Optionally add NARs to binary cache accessorEelco Dolstra1-30/+36
This enables an optimisation in hydra-queue-runner, preventing a download of a NAR it just uploaded to the cache when reading files like hydra-build-products.
2016-02-25 Add NAR / Store accessor abstractionEelco Dolstra1-4/+76
This is primary to allow hydra-queue-runner to extract files like "nix-support/hydra-build-products" from NARs in binary caches.
2016-02-24 BinaryCacheStore: Implement addToStore()Eelco Dolstra1-0/+50
So now you can do $ NIX_REMOTE=file:///tmp/binary-cache nix-instantiate '<nixpkgs>' -A hello and lots of other operations.
2016-02-24 Show a proper error message for unimplemented binary cache operationsEelco Dolstra1-0/+5
2016-02-24 Move BinaryCacheStore / LocalBinaryCacheStore from HydraEelco Dolstra1-0/+292
So you can now do: $ NIX_REMOTE=file:///tmp/binary-cache nix-store -qR /nix/store/...