Almost 600 lines of OpenAPI documentation later and I'm done. I think I'll package the `/doc` endpoint with the Docker images since I can just copy over the static directory and have it live in the container. I'll add directions on how to add the docs to the standalone binaries as well which should cover that use case. Overall, it turned out pretty well.
Initial release done for the Sisyphus server, had to do it manually for the time being which is slightly annoying. I'll deal with the pipeline much later. Posted AMD64 and ARM64 binaries for Windows, Linux, And macOS. Got a lot done over the last few days, now time to relax...lol
https://git.jamesthebard.net/jweatherly/sisyphus-server-golang/releases
So, got the server in place but discovered that the Docker image that I created that has the Sisyphus client and all of the binaries like `ffmpeg`, `av1an` was not very happy. Ffmpeg crashed because it couldn't find the `libSvtAvcEnc.so.4` library which was because I had a custom version of it installed (`svt-av1-psyex`).
Got the Dockerfile fixed by installing `svt-av1-psyex` and then compiling `ffmpeg` against those libraries, then installing both `svt-av1-psyex` and `ffmpeg` into the final container which makes `ffmpeg` happy. Also saw an issue where the Vapoursynth `lsmash` module wasn't being found, but that got tracked down to a stale Docker image (forgot to pull the latest from the repo).
I have two encodes going: one `ffmpeg` and one `av1an` which should be the real final test. If they turn out well, attachments where they're supposed to be, etc., etc. then I'll probably start working on documentation and get this out there.
#sisyphus #encoding #av1an #vapoursynth #ffmpeg #svtAv1Psyex
So, decided to get them rookie `/queue` numbers up so did a quick bit of caching. For a 12-job queue, I went from 240 RPS (Python/Flask) to 680 (Golang/Gin) then to 3400 RPS with some proper caching. The `/workers` endpoint would benefit as well, but I think its performant enough though I may end up adding a bit of caching later.
The rewrite of the Sisyphus server continues, I've got all of the GET endpoints and about 60% of all the endpoints finished overall. Some initial testing on the `/workers` and `/queue` endpoints show some worrying results from the old version and some great results from the new version. The `/workers` endpoint started throwing errors at about 800 RPS on the Python/Flask version (the old one), the rewrite is showing around 4800 RPS (Golang/Gin). The `/queue` endpoint doesn't show any errors for either version during testing, but old vs. new is about 240 vs. 800 RPS.
Subscribe to #sisyphus entries via RSS feed