about summary refs log tree commit diff
path: root/users/Profpatsch/whatcd-resolver/src/Redacted.hs
AgeCommit message (Collapse)AuthorFilesLines
2024-09-13 r/8679 feat(users/Profpatsch/whatcd-resolver): add format to tableProfpatsch1-4/+13
Change-Id: I6ca18ad9f73a8e75e4bfb77156d19604ab27b284 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12331 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-09-13 r/8678 fix(users/Profpatsch/whatcd-resolver): prefer downloaded torrentsProfpatsch1-1/+5
I changed the seeding weight, so now it would not show already downloaded torrents, prompting me to fetch stuff that I already have in new qualities. Obviously, that’s not the best idea. Kinda surprised it’s this easy to fix heh. Change-Id: I6bbf325672a91d794d144c006ccf3d702a581bce Reviewed-on: https://cl.tvl.fyi/c/depot/+/12330 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-09-13 r/8675 fix(users/Profpatsch/whatcd-resolver): pretty AppExceptionProfpatsch1-2/+2
AppException would be a console-pretty-printed version for http errors, which would print all the escape codes in the jaeger traces of the exception, making it more-or-less unreadable. So instead, let’s make AppException two cases, an ErrorTree case which is printed as-is (no color), and a “Pretty” case which is printed using the pretty module (colors on console, no colors in otel). Somewhat involved, I guess this is temporary until I figure out what is really needed. Change-Id: Iff4a8651c5f5368a5b798541efc19cc7ab9de34b Reviewed-on: https://cl.tvl.fyi/c/depot/+/12232 Reviewed-by: Profpatsch <mail@profpatsch.de> Tested-by: BuildkiteCI
2024-08-06 r/8449 fix(users/Profpatsch/whatcd-resolver): reduce json data from dbProfpatsch1-14/+10
We’d transfer the full json data for each torrent from the db instead of just the 2 or 3 fields we need. Adds some more helpers for parsing database values. Adds some better logging events & traces. Change-Id: I5db386c4ea247febf5f9fc3815da2e7f11286d41 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12140 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-08-06 r/8447 fix(users/Profpatsch/whatcd-resolver): SQL formatting offProfpatsch1-1/+0
It turns out the pg_format thing is just too slow for my use-cases most of the time, even when pooling the mf. Most queries stay 90%+ in the perl script, even though they are very fast to execute on their own, screwing up the traces a lot. So instead I replace the `postgres-simple` quasi-quoter that strips whitespace (and tends to screw up queries anyway) with a simple one that just removes the outer indentation up to the first line. Why did I spend so much time on pg_format haha Change-Id: I911cd869deec68aa5cf430ff4d111b0662ec6d28 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12138 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-08-06 r/8445 refactor(users/Profpatsch/whatcd-resolver): continue httpProfpatsch1-5/+3
Ideally there’d be a better generic abstraction of doing basic http calls (with tracing) in the future, but for now just reexport. Change-Id: Id7548739ea62e9172f2773f8db79fe726096b7f1 Reviewed-on: https://cl.tvl.fyi/c/depot/+/12136 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-08-06 r/8444 refactor(users/Profpatsch/whatcd-resolver): start moving http stuffProfpatsch1-42/+2
There’s a bunch of duplication in how http client things are done, let’s move that all to a single module. Change-Id: Ic08c9bce49d562e4fa640a5bdfc15973a28a7bcb Reviewed-on: https://cl.tvl.fyi/c/depot/+/12135 Reviewed-by: Profpatsch <mail@profpatsch.de> Tested-by: BuildkiteCI
2024-07-30 r/8427 feat(users/Profpatsch/whatcd-resolver): read redacted key from envProfpatsch1-13/+20
Change-Id: I5667710423aeeacfbb8dddf5b0b8750dc8f878aa Reviewed-on: https://cl.tvl.fyi/c/depot/+/12055 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-06-07 r/8223 refactor(users/Profpatsch/whatcd-resolver): split table data fetchProfpatsch1-2/+2
Change-Id: Ic9b2f1e6a5ff0c65b93c1662bad75fb41c86bfcd Reviewed-on: https://cl.tvl.fyi/c/depot/+/11759 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de> Autosubmit: Profpatsch <mail@profpatsch.de>
2024-06-03 r/8208 fix(users/Profpatsch/whatcd-resolver): fix torrent linkProfpatsch1-1/+1
The redacted URL needs the torrent group id to go to the album page, not the torrent id. Also open the external link in a separate tab. Change-Id: Ie6d73cb02137855bb388859d2800968cd56ece49 Reviewed-on: https://cl.tvl.fyi/c/depot/+/11745 Reviewed-by: Profpatsch <mail@profpatsch.de> Tested-by: BuildkiteCI Autosubmit: Profpatsch <mail@profpatsch.de>
2024-06-03 r/8207 feat(users/Profpatsch/whatcd-resolver): add redacted torrent linkProfpatsch1-6/+3
Change-Id: I9e2cd1935a67260cc7e4b72b247c01495e130949 Reviewed-on: https://cl.tvl.fyi/c/depot/+/11744 Autosubmit: Profpatsch <mail@profpatsch.de> Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-06-03 r/8206 fix(users/Profpatsch/whatcd-resolver): db_id -> redacted_idProfpatsch1-2/+2
We’re using the redacted id, not the database id. This is more stable. Change-Id: I4d24e5bc6cc469d811cb1402a83157359576ef77 Reviewed-on: https://cl.tvl.fyi/c/depot/+/11683 Autosubmit: Profpatsch <mail@profpatsch.de> Reviewed-by: Profpatsch <mail@profpatsch.de> Tested-by: BuildkiteCI
2024-06-03 r/8204 fix(users/Profpatsch/whatcd-resolver): speed up table queryProfpatsch1-27/+23
This took a while to figure out, but essentially sorting a thing with one million queries takes a long time, as compared to doing it on a small subset of things and then joining against the final ordering. The generated column helps, too. Change-Id: I1bf283e2be060748eebda92576e3d062c51a6777 Reviewed-on: https://cl.tvl.fyi/c/depot/+/11681 Autosubmit: Profpatsch <mail@profpatsch.de> Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-06-03 r/8200 feat(users/Profpatsch/whatcd-resolver): add artist albumsProfpatsch1-10/+43
Simple artist album page that only shows albums the artist was involved with. Change-Id: Icff34afc6d1b39b6fb17765c1b3ea500dd4b4d95 Reviewed-on: https://cl.tvl.fyi/c/depot/+/11675 Tested-by: BuildkiteCI Autosubmit: Profpatsch <mail@profpatsch.de> Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-06-03 r/8195 feat(users/Profpatsch/whatcd-resolver): display all artistsProfpatsch1-4/+10
apparently the `torrent_group` json only contains one artist, while the torrent itself contains a list of them. This is important, because we need the artist id and the `torrent_group` does not provide it, only the torrent one. Change-Id: I3db45f454f14e89ea8c8dafba2065ecd55f5bcda Reviewed-on: https://cl.tvl.fyi/c/depot/+/11670 Autosubmit: Profpatsch <mail@profpatsch.de> Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-05-13 r/8131 feat(users/Profpatsch/whatcd-resolver): allow listing only downloadProfpatsch1-4/+7
When showing the best torrents table, we want to be able to filter for “only downloaded”. Change-Id: Ibfe9212f3d422d305f858fbef023ee985c1183d6 Reviewed-on: https://cl.tvl.fyi/c/depot/+/11650 Autosubmit: Profpatsch <mail@profpatsch.de> Reviewed-by: Profpatsch <mail@profpatsch.de> Tested-by: BuildkiteCI
2024-03-23 r/7766 feat(users/Profpatsch/whatcd-resolver): trace http requestsProfpatsch1-17/+5
Move the http calls into their own module, so we can trace the request and provide a simple copy-to-replay command. We have to work around a bug in the otel library, which would limit our attribute value length to 128 bytes because it uses the wrong option value. ~~~ `ifExists` is finally made more useful for dealing with optional attributes in e.g. lists. Change-Id: Iafab523e9ec4b00136db43f31fdc12aeefb7f77c Reviewed-on: https://cl.tvl.fyi/c/depot/+/11241 Tested-by: BuildkiteCI Autosubmit: Profpatsch <mail@profpatsch.de> Reviewed-by: Profpatsch <mail@profpatsch.de>
2024-03-23 r/7761 chore(users/Profpatsch/whatcd-resolver): Transmission & RedactedProfpatsch1-0/+549
Move the functionality into two coarse modules. There’s still the question about whether functions that change the database tables should be in their own storage module, but let’s see if it gets too confusing. Change-Id: Ied1d47b353dd4597ffea35f111f440aad22e981d Reviewed-on: https://cl.tvl.fyi/c/depot/+/11238 Tested-by: BuildkiteCI Reviewed-by: Profpatsch <mail@profpatsch.de> Autosubmit: Profpatsch <mail@profpatsch.de>