depot - monorepo for the virus lounge

Age	Commit message (Collapse)	Author	Files	Lines
2019-10-03	feat(server): Implement package for creating image manifests	Vincent Ambo	1	-0/+114
	The new manifest package creates image manifests and their configuration. This previously happened in Nix, but is now part of the server's workload. This relates to #50.
2019-10-03	feat(server): Reimplement creation & uploading of layers	Vincent Ambo	3	-87/+250
	The new build process can now call out to Nix to create layers and upload them to the bucket if necessary. The layer cache is populated, but not yet used.
2019-10-03	refactor(server): Introduce a state type to carry runtime state	Vincent Ambo	2	-11/+31
	The state type contains things such as the bucket handle and Nixery's configuration which need to be passed around in the builder. This is only added for convenience.
2019-10-03	feat(server): Add cache for layer builds in GCS & local cache	Vincent Ambo	1	-0/+86
	This cache is going to be used for looking up whether a layer build has taken place already (based on a hash of the layer contents). See the caching section in the updated documentation for details. Relates to #50.
2019-10-03	feat(server): Introduce function to hash contents of a layer	Vincent Ambo	1	-0/+13
	This creates a cache key which can be used to check if a layer has already been built.
2019-10-03	refactor(server): Expose layer grouping logic via a function	Vincent Ambo	1	-55/+24
	Refactors the layer grouping package (which previously compiled to a separate binary) to expose the layer grouping logic via a function instead. This is the next step towards creating layers inside of the server component instead of in Nix. Relates to #50.
2019-10-03	chore(server): Import layer grouping logic into server component	Vincent Ambo	2	-0/+361

2019-09-21	feat(server): Log Nix output live during the builds	Vincent Ambo	1	-3/+12
	Instead of dumping all Nix output as one at the end of the build process, stream it live as the lines come in. This is a lot more useful for debugging stuff like where manifest retrievals get stuck.
2019-09-21	feat: Add configuration option for popularity data URL	Vincent Ambo	2	-0/+6

2019-09-10	refactor(builder): Calculate image cache key only once	Vincent Ambo	2	-17/+15

2019-09-10	feat(server): Cache built manifests to the GCS bucket	Vincent Ambo	3	-23/+96
	Caches manifests under `manifests/$cacheKey` in the GCS bucket and introduces two-tiered retrieval of manifests from the caches (local first, bucket second). There is some cleanup to be done in this code, but the initial version works.
2019-09-10	refactor(server): Use package source specific cache keys	Vincent Ambo	2	-32/+21
	Use the PackageSource.CacheKey function introduced in the previous commit to determine the key at which a manifest should be cached in the local cache. Due to this change, manifests for moving target sources are no longer cached and the recency threshold logic has been removed.
2019-09-10	refactor(server): Move package source management logic to server	Vincent Ambo	4	-61/+173
	Introduces three new types representing each of the possible package sources and moves the logic for specifying the package source to the server. Concrete changes: * Determining whether a specified git reference is a commit vs. a branch/tag is now done in the server, and is done more precisely by using a regular expression. * Package sources now have a new `CacheKey` function which can be used to retrieve a key under which a build manifest can be cached if the package source is not a moving target (i.e. a full git commit hash of either nixpkgs or a private repository). This function is not yet used. * Users must now specify a package source, Nixery no longer defaults to anything and will fail to launch if no source is configured.
2019-09-02	feat(server): Add configuration option for Nix build timeouts	Vincent Ambo	2	-6/+11
	Adds a NIX_TIMEOUT environment variable which can be set to a number of seconds that is the maximum allowed time each Nix builder can run. By default this is set to 60 seconds, which should be plenty for most use-cases as Nixery is not expected to be performing builds of uncached binaries in most production cases. Currently the errors Nix throws on a build timeout are not separated from other types of errors, meaning that users will see a generic 500 server error in case of a timeout. This fixes #47
2019-08-17	fix(server): Sort requested packages in image name & spec	Vincent Ambo	1	-3/+13
	Before this change, Nixery would pass on the image name unmodified to Nix which would lead it to cache-bust the manifest and configuration layers for images that are content-identical but have different package ordering. This fixes #38.
2019-08-16	feat(server): add iana-etc and cacert to the shell convenience package	Florian Klink	1	-1/+1
	These probably should be part of every container image by default, but adding it to the "shell" convenience name probably is our best bet for now.
2019-08-14	chore(server): Add 'go vet' to build process	Vincent Ambo	1	-0/+8

2019-08-14	fix(server): Print correct project name during startup	Vincent Ambo	1	-1/+1
	They grow up so fast :')
2019-08-14	feat(builder): Implement build cache for manifests & layers	Vincent Ambo	3	-42/+152
	Implements a cache that keeps track of: a) Manifests that have already been built (for up to 6 hours) b) Layers that have already been seen (and uploaded to GCS) This significantly speeds up response times for images that are full or partial matches with previous images served by an instance.
2019-08-14	refactor(server): Extract build logic into separate module	Vincent Ambo	3	-304/+365
	This module is going to get more complex as the implementation of #32 progresses.
2019-08-14	style: Apply nixfmt to trivial Nix files	Vincent Ambo	1	-2/+2
	ALl the ones except for build-image.nix are considered trivial. On the latter, nixfmt makes some useful changes but by-and-large it is not ready for that code yet.
2019-08-14	refactor(server): Use wrapper script to avoid path dependency	Vincent Ambo	2	-6/+16
	Instead of requiring the server component to be made aware of the location of the Nix builder via environment variables, this commit introduces a wrapper script for the builder that can simply exist on the builders $PATH. This is one step towards a slightly nicer out-of-the-box experience when using `nix-build -A nixery-bin`.
2019-08-14	refactor: Move registry server to a subfolder	Vincent Ambo	3	-0/+619