Swiftshader download timeouts

[Firestar99]

This is a forward of Rust-GPU/rust-gpu#407

We're using your action to also install swiftshader, and it's failing regularly with:

Cache hit for: cache-windows-x64-vulkan-sdk-1.4.321.0
Received 12582912 of 309024038 (4.1%), 11.9 MBs/sec
Received 130023424 of 309024038 (42.1%), 61.5 MBs/sec
Received 213909504 of 309024038 (69.2%), 67.6 MBs/sec
Received 309024038 of 309024038 (100.0%), 75.7 MBs/sec
Cache Size: ~295 MB (309024038 B)
"C:\Program Files\Git\usr\bin\tar.exe" -xf D:/a/_temp/9348adc7-f64f-47a5-8fa3-92ec9196b90e/cache.tzst -P -C D:/a/rust-gpu/rust-gpu --force-local --use-compress-program "zstd -d"
Cache restored successfully
🎯 [Cache] Restored Vulkan SDK in path: 'C:\VulkanSDK\'. Cache Restore ID: 'cache-windows-x64-vulkan-sdk-1.4.321.0'.
✔️ [PATH] Added path to Vulkan SDK to environment variable PATH.
✔️ [ENV] Set env variable VULKAN_SDK -> "C:\VulkanSDK\1.4.321.0".
✔️ [ENV] Set env variable VULKAN_VERSION -> "1.4.321.0".
✔️ [INFO] Path to Vulkan Runtime: C:\VulkanSDK\1.4.321.0\runtime
🚀 Installing SwiftShader library...
Error: HttpClientError: API rate limit exceeded for 40.65.59.112. (But here's the good news: Authenticated requests get a higher rate limit. Check out the documentation for more details.)
    at HttpClient.rejected (D:\a\_actions\jakoch\install-vulkan-sdk-action\v1\node_modules\@actions\http-client\lib\index.js:640:1)
    at Generator.next (<anonymous>)
    at fulfilled (D:\a\_actions\jakoch\install-vulkan-sdk-action\v1\node_modules\@actions\http-client\lib\index.js:30:1)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)

See latest fail in https://github.com/Rust-GPU/rust-gpu/actions/runs/20307661297/job/58329517746 on a regular github runner (not self-hosted).

I assume that message is github rate limiting access to your https://github.com/jakoch/rasterizers repo

Steps we're taken:

• We're improved our stability by only installing swiftshader where necessary
• From improve caching strategy #492, it seems like the swiftshader download is not cached, so every run will redownload it, adding to the rate limit
• I also haven't seen any way to do auth with your action

[jakoch]

Ooof.

the swiftshader download is not cached

Of course, the caching feature that hasn’t been implemented yet would help reduce the number of downloads.

I assume that message is github rate limiting access

But how does this increase the rate-limit?
The SwiftShader installer makes two requests: a HEAD request to verify download availability, followed by a GET request.
AFAIK, making a requests to the Github Release downloads doesn't count against the GitHub REST API rate limit. Or does it?

It could be related to the number of parallel downloads.
I’ll need to check whether and where the action makes any API requests.

Maybe the caching checks for Vulkan (performed in parallel), could contribute to the rate limit... but this is a caching endpoint and also not the Github REST API.

I also haven't seen any way to do auth with your action

Authentication shouldn’t be required for the downloads at all, since they are public (and not LFS objects). They could also be downloaded manually using curl with an un-authed request.

[jakoch]

Ok, found the origin: https://github.com/jakoch/install-vulkan-sdk-action/blob/main/src/github.ts#L36-L43
https://api.github.com/repos/jakoch/rasterizers/releases/latest

So the order of requests is:

1. GET getLatestRelease → API call → counts toward limit
2. GET download versions.json → normal HTTP download → does not count
3. HEAD for download URL → does not count
4. GET for download URL → normal HTTP download → does not count

I also haven't seen any way to do auth with your action

Ok, the getLatestRelease API request needs to be done using the GITHUB_TOKEN from the env...

[jakoch]

Auth was implemented and released with v1.3.0.

This enables you to auth using the env var GITHUB_TOKEN.

 env:
   GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

Meanwhile, i've also added github_token as Input parameter to the action.

github_token: ${{ secrets.GITHUB_TOKEN }}

[Firestar99]

Here's a job in this very repository failing with a timeout: https://github.com/jakoch/install-vulkan-sdk-action/actions/runs/20746227579/job/59564122301?pr=546

And a second one: https://github.com/jakoch/install-vulkan-sdk-action/actions/runs/20746699550/job/59565644710?pr=546