about summary refs log tree commit diff
path: root/default.nix (follow)
AgeCommit message (Collapse)AuthorFilesLines
2021-09-20 r/2891 refactor(depot): Import depot.path using lib.cleanSourceVincent Ambo1-1/+1
This imports a copy of the depot as `depot.path` without including the .git directory and other stuff that isn't tracked in the tree. Significantly reduces thie amount of data copied into the store. Change-Id: I567c0f969d1cea81d121588548f6db627c8f3432 Reviewed-on: https://cl.tvl.fyi/c/depot/+/3601 Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org>
2021-09-15 r/2869 feat(nix/readTree): record list of children added by readTreesterni1-1/+2
This change adds a new attribute to readTree nodes, `__readTreeChildren` which is a list of attribute names added to this node by readTree. This is then used by `gather` for `ci.targets` to avoid evaluating attributes unnecessarily. Especially since Nix is not as lazy as we'd like when determining types (i. e. child ? __readTree needs to force `child` even when it's not an attribute set), evaluating attributes unnecessarily is sometimes problematic. Change-Id: I0a98691d41f987e23ee7e9ba21fbe465da5fe402
2021-09-10 r/2833 chore(nint): move from //users/sterni to //nixsterni1-5/+0
Since //web/bubblegum depends on nint, we need to move it to a non user directory to conform with the policy established via cl/3434. Note that this likely doesn't mean greater stability (which isn't really implied in depot anyways), since I still would like to use a more elaborate calling convention to allow for additional useful features. Change-Id: I616f905d8df13e3363674aab69a797b0d39fdd79 Reviewed-on: https://cl.tvl.fyi/c/depot/+/3506 Tested-by: BuildkiteCI Reviewed-by: tazjin <mail@tazj.in>
2021-09-09 r/2826 feat(depot): Prevent imports from NIX_PATH within the depotVincent Ambo1-0/+3
Provided without further comment. Change-Id: I19d14530243c72d49b14526f769b964b06959db8 Reviewed-on: https://cl.tvl.fyi/c/depot/+/3500 Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org> Reviewed-by: grfn <grfn@gws.fyi>
2021-09-08 r/2824 refactor(readTree): Pass all readTree parameters as function argsVincent Ambo1-4/+6
Instead of having a mix of depot-passed args (for the filter) and args to the readTree function itself, make everything a single attribute set of arguments passed to the function. This also makes it a bit easier to extend this in the future. Change-Id: I633c1fc96026d137b451bb604ef92be32571a0f5 Reviewed-on: https://cl.tvl.fyi/c/depot/+/3498 Tested-by: BuildkiteCI Reviewed-by: grfn <grfn@gws.fyi>
2021-08-26 r/2796 fix(ops): Add another target that needs a //users exceptionVincent Ambo1-1/+2
Change-Id: I3edede16890893e14727283a12c7fa3310cb4dc0 Reviewed-on: https://cl.tvl.fyi/c/depot/+/3441 Reviewed-by: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI
2021-08-26 r/2794 style(depot): Use depot path format for args filter errorsVincent Ambo1-1/+1
As pointed out by sterni, we don't need lib for this. Change-Id: Ide9719641098f770a098a938d047afa0dcb5dc6d Reviewed-on: https://cl.tvl.fyi/c/depot/+/3439 Reviewed-by: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI
2021-08-26 r/2793 feat(depot): Disallow access to //users from outside of itVincent Ambo1-1/+44
Code under this depot path is essentially unstable and potentially unreviewed - this is a good thing (people can play around with cursed stuff all they want), but we should not make the rest of the repository depend on any of it. Any cursed things that are required outside of users can be moved to a different depot path if people agree with that. Change-Id: I46a34a0e9662069c01b43d9a653e5545e325e587 Reviewed-on: https://cl.tvl.fyi/c/depot/+/3434 Tested-by: BuildkiteCI Reviewed-by: grfn <grfn@gws.fyi>
2021-04-12 r/2497 refactor: Replace 'depotPath' with 'depot.path'Vincent Ambo1-6/+3
Instead of having two ways of accessing the path to the depot (one of which was stuttering, depot.depotPath) we settle on only one: depot.path. This was mostly used for NixOS module imports. Co-Authored-By: Florian Klink <flokli@flokli.de> Change-Id: I2c0db23383fc34f6ca76baaad4cc4af2d9dfae15 Reviewed-on: https://cl.tvl.fyi/c/depot/+/2962 Tested-by: BuildkiteCI Reviewed-by: grfn <grfn@gws.fyi> Reviewed-by: sterni <sternenseemann@systemli.org>
2021-04-12 r/2496 refactor(readTree): Initialise repo roots without recursingVincent Ambo1-53/+28
Plumbs an additional internal argument through readTree that indicates whether the top-level of a tree is being read, and avoids recursing into itself in that case. This changes the externally visible behaviour of readTree (it is now expected to be called a level higher than previously). This allows us to reduce the amount of boilerplate needed to bootstrap the TVL repository (by not having to specify the individual folders that need to be read). For reasons related to an infinite recursion we could not (be bothered to) debug, the top-level `config` key (which held the attribute set passed on by readTree) has been removed. This is not needed, as it is already passed on by readTree ... Co-Authored-By: Florian Klink <flokli@flokli.de> Change-Id: Id6e39b57b2f5b3473c4b695a72dd1d01fcfb7a66 Reviewed-on: https://cl.tvl.fyi/c/depot/+/2961 Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org> Reviewed-by: grfn <grfn@gws.fyi>
2021-04-11 r/2477 feat(ops/pipelines): Add gcroots for depot builds on canonVincent Ambo1-0/+6
Adds a conditional build step that only runs on the canon branch, and only if :duck: (the status reporting step) succeeds, which creates a new Nix GC root for all depot targets named `depot-canon`. In practice this might be a bit racey, as canon builds are not guaranteed to succeed in order (though it is likely). This shouldn't matter much in practice: We only want to prevent rebuilds of the whole world. This fixes b/102 Change-Id: Id3d0bf4158bffcb1ed6929888a29d31609b6ece1 Reviewed-on: https://cl.tvl.fyi/c/depot/+/2904 Tested-by: BuildkiteCI Reviewed-by: glittershark <grfn@gws.fyi>
2021-04-11 r/2473 feat(3p/nixpkgs): Plumb through externalArgs.nixpkgsBisectPathVincent Ambo1-1/+8
This lets the import of the depot root accept an additional argument called `externalArgs`, which can be used to pass additional arguments into a depot package set. This is used in //third_party/nixpkgs for replacing the source of the nixos-unstable channel with a path. With this we can bisect the nixpkgs used in third_party easily. Change-Id: I4f65eb3d6b521ed9f437649b7b068f1e6ab8210f Reviewed-on: https://cl.tvl.fyi/c/depot/+/2925 Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org>
2021-04-10 r/2470 refactor: Move nixpkgs attribute to `third_party.nixpkgs`Vincent Ambo1-5/+5
Please read b/108 to make sense of this. This gets rid of the explicit list of exposed packages from nixpkgs, and instead makes the entire package set available at `third_party.nixpkgs`. To accommodate this, a LOT of things have to be very slightly shuffled around. Some of this was done in already submitted CLs, but this change is unfortunately still quite noisy. Pay extra attention to: * overlay-like functionality that was partially moved to actual overlays (partially as in, the minimum required to get a green build) * modified uses of the package set path, esp. in NixOS systems Special notes: * xanthous has been disabled in CI because of issues with the Haskell overlay * //third_party/nix has been disabled because of other unclear dependency issues Both of these will be tackled in a followup CL. Change-Id: I2f9c60a4d275fdb5209264be0addfd7e06c53118 Reviewed-on: https://cl.tvl.fyi/c/depot/+/2910 Reviewed-by: glittershark <grfn@gws.fyi> Reviewed-by: sterni <sternenseemann@systemli.org> Tested-by: BuildkiteCI
2021-03-31 r/2368 fix(tvix): Add //tvix to readTree rootsVincent Ambo1-0/+1
Change-Id: I7d0e81d6a88f351c7451454f5d506d708e7ed9ca Reviewed-on: https://cl.tvl.fyi/c/depot/+/2710 Tested-by: BuildkiteCI Reviewed-by: adisbladis <adisbladis@gmail.com>
2021-03-23 r/2325 chore: Remove //overrides from depotVincent Ambo1-6/+1
This mechanism wasn't actually used for anything other than a minor external compatibility thing for buildGo.nix, which can also be solved with a function parameter. This breaks //fun/gemma because it means that the elmPackages used to build it are no longer reachable from depot. We'll sort this out later. Change-Id: I1bf2240435e869cdc4e99bdd1a138fdd2e76f96e Reviewed-on: https://cl.tvl.fyi/c/depot/+/2646 Tested-by: BuildkiteCI Reviewed-by: sterni <sternenseemann@systemli.org>
2021-02-06 r/2182 fix(config): remove ciBuilds inheritsterni1-2/+2
The ciBuilds attribute seems to no longer exist and it breaks the evaluation of the config attribute. It's only appearance was in besadii which doesn't actually use the attribute. Removing the ciBuilds inherit fixes these issues. Change-Id: Ibbf3413ba6efe10ad868cf57cf0711d574860f97 Reviewed-on: https://cl.tvl.fyi/c/depot/+/2487 Tested-by: BuildkiteCI Reviewed-by: tazjin <mail@tazj.in>
2020-08-31 r/1748 feat(ci): Add subtarget support for buildsVincent Ambo1-2/+17
We have naturally evolved a distinction between logical and physical targets. Physical targets are those which correspond directly to a tree location on disk and can be built with `-A path.to.files`, while logical targets are those that are exported from within an expression but do not have a corresponding file on disk. This change adds support for exporting logical targets from any tree location by adding a `meta.targets` attribute containing keys into itself, which will be consumed by the CI target gathering logic and included in the generated pipeline. Note that the labels for subtargets are syntactically different to emphasise that they do not correspond to a file location. For example, this change enables 'ops.nixos.whitbySystem' as a subtarget, which is labeled in CI as `ops/nixos:whitbySystem`. Change-Id: Ied09647a62c2ba98e3914548e3742ad422c63ecf Reviewed-on: https://cl.tvl.fyi/c/depot/+/1893 Tested-by: BuildkiteCI Reviewed-by: glittershark <grfn@gws.fyi>
2020-08-31 r/1747 feat(ops/pipelines): Dynamically generate CI pipeline from targetsVincent Ambo1-3/+8
Create the pipeline by outputting a file that contains nix-build invocations for each target's *derivation path*. Each invocation has a generated Nix expression passed to it with `-E` which fetches the correct target from the tree while correctly handling targets with strange characters (such as in Go-packages). This makes it possible to run target-level granular pipelines. We're getting somewhere! Change-Id: Ia6946e389dafd1d4926130bb8891446d6e17133b Reviewed-on: https://cl.tvl.fyi/c/depot/+/1855 Tested-by: BuildkiteCI Reviewed-by: glittershark <grfn@gws.fyi> Reviewed-by: lukegb <lukegb@tvl.fyi>
2020-08-26 r/1725 feat: Implement automatic CI target detection for the depotVincent Ambo1-2/+21
Automatically walk the entire depot tree and pick out things that are "buildable", then include them in the attribute `ci.targets` (which is now also the target for CI builds). A long time ago, in a land far away, we (well, I, at the time) had a prototype of this which ran into constant issues with infinite recursions while trying to walk the tree. In fact, this is why readTree originally gained the `__readTree`-attribute which marks things that were imported automatically. Based on some code edef whipped up earlier (with the breakthrough being that we also add the attribute to top-level folders, which suddenly resolves a whole bunch of problems), I've now implemented this actually working version. At the moment all builds still happen as one big bag of builds, but at some point we will granularise this. Change-Id: I86f12ce7f63dae98e7e5c6646a4e9d220de783f2 Reviewed-on: https://cl.tvl.fyi/c/depot/+/1854 Tested-by: BuildkiteCI Reviewed-by: kanepyork <rikingcoding@gmail.com> Reviewed-by: glittershark <grfn@gws.fyi>
2020-08-26 r/1714 fix: Remove ./presentations from top-levelVincent Ambo1-1/+0
This folder doesn't exist, it's part of my user folder now. We didn't notice because nothing is walking the tree. Change-Id: Idc6f20a8e4806a158c598fd63d381ab07934be1e Reviewed-on: https://cl.tvl.fyi/c/depot/+/1843 Tested-by: BuildkiteCI Reviewed-by: kanepyork <rikingcoding@gmail.com>
2020-06-29 r/1130 chore(ops): Clean up old GCP infrastructure filesVincent Ambo1-7/+0
This removes almost all of the GCP-infrastructure leftovers from my previous setup. The DNS configuration is retained, but moves to my user folder instead. Change-Id: I1867acd379443882f11a3c645846c9902eadd5b0 Reviewed-on: https://cl.tvl.fyi/c/depot/+/782 Tested-by: BuildkiteCI Reviewed-by: eta <eta@theta.eu.org> Reviewed-by: isomer <isomer@tvl.fyi>
2020-06-24 r/1076 refactor(ci-builds): Split up CI builds into multiple bucketsVincent Ambo1-1/+7
These categories separate CI targets, which hopefully avoids the out-of-space errors we have been seeing on Sourcehut. The sets of CI build targets are made available in the depot itself so that besadii can be updated to create a new build for each target group. For convenience, 'ciBuilds' contains an '__allTargets' attribute which combines the contents of each target batch - this makes it possible to still invoke a build for everything by using: nix-build -A ciBuilds.__allTargets Note: Some targets that were previously built in CI aren't anymore, most importantly my NixOS systems which don't fit on Sourcehut. Change-Id: Ia15ed7b743c8add51ae08ce0827a0ddfacd637e2 Reviewed-on: https://cl.tvl.fyi/c/depot/+/570 Reviewed-by: lukegb <lukegb@tvl.fyi>
2020-06-13 r/941 refactor(ops/nixos): Move my NixOS configurations to //users/tazjinVincent Ambo1-0/+1
NixOS modules move one level up because it's unlikely that //ops/nixos will contain actual systems at this point (they're user-specific). This is the first users folder, so it is also added to the root readTree invocation for the repository. Change-Id: I546c701145fa204b7ba7518a8a56a783588629e0 Reviewed-on: https://cl.tvl.fyi/c/depot/+/244 Reviewed-by: tazjin <mail@tazj.in>
2020-06-13 r/940 feat: Add 'depotPath' to depot root importVincent Ambo1-0/+4
This is useful for things like including NixOS modules in configurations without creating long and error-prone relative paths. Change-Id: I4a5ebb1a0e5adf90b6bc50e884db453e12461001 Reviewed-on: https://cl.tvl.fyi/c/depot/+/243 Reviewed-by: lukegb <lukegb@tvl.fyi>
2020-06-08 r/886 chore: Add //net to local package treesVincent Ambo1-1/+2
2020-02-21 r/558 refactor: Pass the depot as an argument named 'depot'Vincent Ambo1-3/+7
This change, which I've been meaning to do for a while, renames the attributes passed by readTree to things in the tree so that: * the depot root is now 'depot' * depot.third_party is additionally passed as 'pkgs' (for compatibility with exported subtrees)
2020-01-22 r/448 feat(lisp/dns): Check in very early DNS-over-HTTPS clientVincent Ambo1-0/+1
This includes very barebones support for querying TXT and MX records right now. The returned structure is not turned into a more convenient format and error handling is, well, NIL.
2020-01-11 r/369 fix(build): Pass 'lib' as readTree argument to packagesVincent Ambo1-1/+1
2019-12-21 r/279 refactor(nix/readTree): Move readTree to its own subfolderVincent Ambo1-1/+1
2019-12-21 r/265 feat(bootstrapping-2018): Fix build and check in built presentationVincent Ambo1-6/+7
This lets people browse the folder more easily, should they be so inclined for whatever reason.
2019-12-20 r/240 fix: Various minor fixes for new repository layoutVincent Ambo1-1/+1
2019-12-20 r/238 refactor: Fix a variety of filepaths for repo relayoutingVincent Ambo1-28/+6
This fixes readTree and the various project builds, as well as (hopefully) most documentation links inside of the projects.
2019-12-19 r/204 chore(build): Add package required for buildGo at the top-levelVincent Ambo1-1/+10
This is required to maintain buildGo compatibility with non-depot setups.
2019-12-18 r/188 fix(build): Add missing packages for Nixery imagesVincent Ambo1-0/+3
2019-12-18 r/183 fix(build): Fix compatibility with Nixery instanceVincent Ambo1-1/+14
2019-12-16 r/166 feat: Expose readTree for downstream consumersVincent Ambo1-0/+6
Exposes readTree from the package set but with a twist: It's exposed as a functor that references the `.config` field from itself to get at the configuration to be passed to packages. This makes it possible for downstream users to make use of `readTree` but with their own configuration.
2019-12-13 r/128 fix(build): Make repository callable in NixVincent Ambo1-0/+2
This is required for some things that expect package sets to be callable, e.g. Nixery.
2019-12-09 r/111 refactor: Move CI setup to separate Nix fileVincent Ambo1-22/+0
Instead of polluting the repository namespace with the list of CI projects, move that to a separate file. Currently the list of projects to be built by CI is still hardcoded, but this will be fixed soon.
2019-12-09 r/101 fix(build): Temporarily hardcode list of CI projectsVincent Ambo1-4/+12
Due to a missing feature in readTree I can't currently generate this list automatically.
2019-12-09 r/100 refactor: Introduce new layout with nixpkgs in third_partyVincent Ambo1-39/+45
This is not the final layout yet, but makes it so that my top-level attribute set is no longer overlaid into nixpkgs itself. This is useful for other people who are importing my monorepo.
2019-11-15 feat(nix): Filter projects that should be built by CIVincent Ambo1-13/+20
Instead of specifying CI projects manually, this filters them to move the CI configuration into the derivations `meta` attributes.
2019-11-15 chore(nix): Move files around to conform to new read-tree layoutVincent Ambo1-64/+20
Broadly speaking, the following things are included: * there is now a uniform `args` struct that is passed to all derivations, package headers have been changed appropriately * overrides are now loaded from a separate `override` folder just using read-tree.nix * third-party packages have moved into the `third_party` attribute set
2019-11-14 chore: Remove unstable channel (no longer in use)Vincent Ambo1-7/+0
2019-10-26 feat(services): Add nixcon-demo service with simple web serverVincent Ambo1-0/+1
2019-10-26 feat(third_party): Add naersk to package setVincent Ambo1-0/+6
2019-10-26 r/93 fix: Enable building of broken packagesVincent Ambo1-0/+1
Happstack is currently erroneously (afaict) marked as broken.
2019-10-25 chore: Bump nixpkgs and use Terraform from stableVincent Ambo1-3/+3
2019-09-22 r/88 refactor(build): Add ciProjects attribute for CI buildsVincent Ambo1-0/+8
This attribute contains a list of all derivations that should be built by the CI for this repository. This includes all of my own packages that are not marked as broken, as well as select third-party packages.
2019-09-21 r/85 chore: Bump Nix channel to a more recent versionVincent Ambo1-2/+2
This version has Nixery popularity data available.
2019-09-04 chore: Update kontemplate to v1.8.0Vincent Ambo1-4/+13
This version is agnostic of the working directory even if insertFile/insertTemplate are used, which makes it a lot nicer to work with in this repository structure.
generated by cgit-pink 1.4.1 (git 2.44.0) at 2024-05-02T17·36+0000