# Microsoft's ONNX Runtime repo went 404 on GitHub and broke CI builds. PyPI and NuGet still work: what to do

> Since about 22:20 UTC on November 17, github.com/microsoft/onnxruntime and its release downloads have returned 404, breaking builds that fetch the inference engine from GitHub. Microsoft hasn't explained the ONNX outage, but told The Register it made "some repositories private" while investigating malicious content. The PyPI and NuGet packages are unaffected. Switch downloads to them and pin hashes.

Published Nov 19, 2026 by TechMeasured Staff · Repos · Canonical: https://techmeasured.com/repos/microsoft-onnx-runtime-github-repo-404-ci-builds-break-nuget-pypi-still-work-what-to-do

**Microsoft's ONNX Runtime repository has been missing from GitHub since late November 17.** According to a fix merged into the xLights project, starting around **22:20 UTC** that day, `github.com/microsoft/onnxruntime`, its API endpoint and every release asset returned **404**. An issue filed on the ONNX project the same day reported that `microsoft/onnxruntime-swift-package-manager` had gone too. byteiota, citing RuntimeWire, reports that seven or more related repositories went too. The repo had no archive banner, redirect or notice. A thread about the outage reached 452 points on the Hacker News front page on November 18.

Why it matters: ONNX Runtime is Microsoft's widely used engine for running machine-learning models on CPUs, GPUs and other accelerators. A lot of software pulls its prebuilt native libraries straight from GitHub release URLs at build time, and some apps do so at runtime. All of those downloads now fail.

## What broke

Public issue trackers show the damage:

| Project | What failed |
|---|---|
| xLights | Ubuntu CI stopped because `onnxruntime-linux-x64-1.24.4.tgz` couldn't be downloaded |
| c3-skill | Release builds failed, and installs without a cached library lost semantic search |
| ACE-Step-Studio | The lyrics-sync pack download fails on an ONNX Runtime 1.31.1 asset (song creation still works) |

The c3-skill issue also points out a separate weakness: its download had **no checksum verification**. That gap matters more if you're now swapping in a new source in a hurry.

## What Microsoft has said

Microsoft hasn't explained the ONNX Runtime outage specifically. The timing lines up with the hijack of Microsoft's `agent-framework` package on PyPI on November 17 ([our coverage](/security/microsoft-agent-framework-pypi-1-26-1-1-26-2-credential-stealer-what-to-check-rotate)). In its report on that hijack, a Microsoft spokesperson told The Register: "We have made some repositories private while we investigate malicious content." The Register also notes that neither Microsoft nor security researchers have connected the ONNX repo's disappearance to the malware campaign. The c3-skill and ACE-Step-Studio issues both say **ONNX Runtime itself has not been reported as compromised**.

byteiota reports that Microsoft also briefly pulled about 70 open-source repositories in June 2026. We haven't verified that claim independently.

**Is it back?** Reports disagree. Publicasta, updated November 19, says later checks found the repository reachable again but gives no time. When TechMeasured queried GitHub's search API at about 16:05 UTC on November 19, scoping the search to `microsoft/onnxruntime` returned an error saying the repository doesn't exist or isn't visible. Until Microsoft says otherwise, assume GitHub downloads are unreliable.

## What still works

The DEV Community write-up, byteiota and Publicasta all report that these channels are unaffected:

- the **`onnxruntime` package on PyPI** (`pip install onnxruntime` works)
- **`Microsoft.ML.OnnxRuntime` on NuGet**
- the **onnxruntime.ai documentation**
- other package channels (Publicasta lists Maven and CocoaPods)

Already-installed builds keep running. Apps that load the library they shipped with don't need GitHub at runtime.

## What to do

1. **Find every GitHub fetch.** Search build scripts, Dockerfiles, Makefiles and lockfiles for `github.com/microsoft/onnxruntime`, and run `git config --file .gitmodules --list` to check submodules. These steps come from the DEV audit.
2. **Pull native libraries from NuGet instead.** The xLights fix shows how: download `Microsoft.ML.OnnxRuntime` **at the same version you had pinned**, then take headers from `build/native/include` and the library from `runtimes/linux-x64/native` (or `linux-arm64`). The package ships a single unversioned `libonnxruntime.so`, so xLights renames it and recreates the `.so.<version>` and `.so.1` symlinks the GitHub tarball used to provide. The rest of the build then works unchanged.
3. **Pin and verify.** Record a sha256 for each artifact you mirror, as the c3-skill fix plans to. Don't let CI quietly fall back to `latest` or nightly builds, and don't switch to an unofficial fork just because the official repo is 404 (Publicasta).
4. **Mirror what you depend on.** Use `git clone --mirror` for source and keep a local cache of release assets and wheels. Prefer your mirror, with the public URL as a fallback. The DEV piece also suggests a weekly CI job that blocks github.com to prove builds still work without it.
5. **If you use `agent-framework`,** check our guide linked above. That incident did involve stolen credentials.

## What to watch

Watch for a statement from Microsoft or the ONNX Runtime maintainers saying whether the repository was made private for a security review and when it will return. If it comes back, compare tags and release-asset hashes against copies you already have before trusting new downloads.


## Sources

1. [GitHub — xLights PR #7388: Linux CI falls back to NuGet for ONNX Runtime when GitHub 404s](https://github.com/xLightsSequencer/xLights/pull/7388)
2. [GitHub — onnx/onnx issue #8842: Onnxruntime has disappeared?](https://github.com/onnx/onnx/issues/8842)
3. [The Register — Microsoft's official Python agent framework hijacked to distribute malware](https://www.theregister.com/security/2026/11/18/microsofts-official-python-agent-framework-hijacked-to-distribute-malware/5310858)
4. [DEV Community — Microsoft/onnxruntime is 404. Here is the audit we ran on our own pipeline](https://dev.to/karmabox/microsoftonnxruntime-is-404-here-is-the-audit-we-ran-on-our-own-pipeline-1530)
5. [byteiota — Microsoft's ONNX Runtime is gone from GitHub](https://byteiota.com/microsoft-onnx-runtime-gone-from-github/)
6. [Publicasta — ONNX Runtime GitHub 404: what developers should check](https://publicasta.com/open_source_radar/onnx_runtime_github_disappearance_source_dependency_resilience)
7. [GitHub — c3-skill issue #77: release builds fail after microsoft/onnxruntime was removed](https://github.com/cuongtranba/c3-skill/issues/77)
8. [GitHub — ACE-Step-Studio issue #75: ONNX Runtime downloads fail](https://github.com/timoncool/ACE-Step-Studio/issues/75)
