This repo (https://github.com/VSCodium/vscodium-insiders) provides binary releases of VS Code (Insiders) without MS branding/telemetry/licensing. It is being maintained to keep track of releases only.
The build scripts and patches to build these releases are found at https://github.com/VSCodium/vscodium, as well as the GitHub Actions that do the actual build.
In the case of any issues with vscodium-insiders please check/report at https://github.com/VSCodium/vscodium/issues.