Run unpatched dynamic binaries on NixOS.
While many proprietary packages in nixpkgs have already been patched with
autoPatchelfHook
patching, there are cases where patching is not possible:
- Use binary executable downloaded with third-party package managers (e.g. vscode, npm or pip) without having to patch them on every update.
- Run games or proprietary software that attempts to verify its integrity.
- Run programs that are too large for the nix store (e.g. FPGA IDEs).
While there are other solutions such as buildFHSUserEnv
that restore a Linux file
hierarchy as found on common Linux systems (ld-linux-x86-64.so.2
), these
sandboxes have their own weaknesses:
- setuid binaries cannot be executed inside a fhsuserenv
- inside a
buildFHSUserEnv
you can not use other sandbox tools like bwrap or 'nix build'. buildFHSUserEnv
requires a subshell which does not work well with direnv
Also read this blog post to get the explaination in full detail. A summary is below:
Precompiled binaries that were not created for NixOS usually have a so-called
link-loader hardcoded into them. On Linux/x86_64 this is for example
/lib64/ld-linux-x86-64.so.2
. for glibc. NixOS, on the other hand, usually has
its dynamic linker in the glibc package in the Nix store and therefore cannot
run these binaries. Nix-ld provides a shim layer for these types of binaries. It
is installed in the same location where other Linux distributions install their
link loader, ie. /lib64/ld-linux-x86-64.so.2
and then loads the actual link
loader as specified in the environment variable NIX_LD
. In addition, it also
accepts a colon-separated path from library lookup paths in NIX_LD_LIBRARY_PATH
.
This environment variable is rewritten to LD_LIBRARY_PATH
before
passing execution to the actual ld. This allows you to specify additional
libraries that the executable needs to run.
nix-ld is part of nixpkgs since NixOS 22.05. There one can enable it with the following nixos setting:
{
programs.nix-ld.enable = true;
}
To install nix-ld
from the repository instead, use the following method:
$ sudo nix-channel --add https://github.com/Mic92/nix-ld/archive/main.tar.gz nix-ld
$ sudo nix-channel --update
/etc/nixos/configuration.nix
{
imports = [
<nix-ld/modules/nix-ld.nix>
];
# The module in this repository defines a new module under (programs.nix-ld.dev) instead of (programs.nix-ld)
# to not collide with the nixpkgs version.
programs.nix-ld.dev.enable = true;
}
Add the following lines to /etc/nixos/flake.nix
. Replace myhostname
with the
actual hostname of your system.
# flake.nix
{
inputs.nixpkgs.url = "github:NixOS/nixpkgs/master";
inputs.nix-ld.url = "github:Mic92/nix-ld";
# this line assume that you also have nixpkgs as an input
inputs.nix-ld.inputs.nixpkgs.follows = "nixpkgs";
outputs = { nix-ld, nixpkgs, ... }: {
# replace `myhostname` with your actual hostname
nixosConfigurations.myhostname = nixpkgs.lib.nixosSystem {
system = "x86_64-linux";
modules = [
# ... add this line to the rest of your configuration modules
nix-ld.nixosModules.nix-ld
# The module in this repository defines a new module under (programs.nix-ld.dev) instead of (programs.nix-ld)
# to not collide with the nixpkgs version.
{ programs.nix-ld.dev.enable = true; }
];
};
};
}
nix-ld honors the following environment variables:
NIX_LD
NIX_LD_{system}
NIX_LD_LIBRARY_PATH
NIX_LD_LIBRARY_PATH_{system}
NIX_LD_LOG
(error, warn, info, debug, trace)
Here {system}
is the value of the Nix system
with dashes replaced with underscores, like x86_64_linux
.
You can also run nix-ld-rs
directly for a list.
After setting up the nix-ld symlink as described above, one needs to set at least
NIX_LD
and NIX_LD_LIBRARY_PATH
to run executables. For example, this can
be done with a shell.nix
in a nix-shell like this:
with import <nixpkgs> {};
mkShell {
NIX_LD_LIBRARY_PATH = lib.makeLibraryPath [
stdenv.cc.cc
openssl
# ...
];
NIX_LD = lib.fileContents "${stdenv.cc}/nix-support/dynamic-linker";
}
A full example is shown in ./examples/masterpdfeditor.nix
.
In nix-autobahn there is also a
script called nix-autobahn-ld
that automates generating shell expressions.
In nix-alien there is another
script called nix-alien-ld
that uses another strategy, wrapping the program in
a writeShellScriptBin
with the NIX_LD
/NIX_LD_LIBRARY_PATH
environment
variables set.
To figure out what libraries a program needs, you can use ldd
on the binary or
set the LD_DEBUG=libs
environment variable.
You can use tools like nix-autobahn, nix-alien or use nix-index
LD_LIBRARY_PATH affects all programs, which can inject the wrong libraries in correct build nix application that have an RPATH set in their executable.
No. Normal Linux distributions will have their own link-loader. Replacing those with nix-ld will break the system.
Nix-ld is only used by unpatched executables that use the link loader at /lib
or /lib64
. If you use for example python from nixpkgs than it will not pick
up NIX_LD_LIBRARY_PATH
and NIX_LD
since these types of binaries are
configured to use a glibc from the nix store. If you encounter these cases i.e.
when you are trying to use python packages installed in a virtualenv than you
need to set LD_LIBRARY_PATH
directly. You can also create yourself a wrapper
like this:
(pkgs.writeShellScriptBin "python" ''
export LD_LIBRARY_PATH=$NIX_LD_LIBRARY_PATH
exec ${pkgs.python3}/bin/python "$@"
'')
The included devShell
provides all dependencies required to build the project.
It's recommended to set up transparent emulation using binfmt-misc so you can run tests on all supported platforms:
{
# x86_64-linux, i686-linux, aarch64-linux
boot.binfmt.emulatedSystems = [ "aarch64-linux" ];
}
Run cargo test
or cargo nextest run
to run the integration tests, and just test
to run them on all supported platforms (binfmt required).
Launch | Seen by ld.so | Seen by getenv() and children (a) | ||||
---|---|---|---|---|---|---|
NIX_LD_LIBRARY_PATH | LD_LIBRARY_PATH | NIX_LD_LIBRARY_PATH | LD_LIBRARY_PATH | NIX_LD_LIBRARY_PATH | LD_LIBRARY_PATH | |
1 | (unset) | (unset) | (unset) | "/run/current-system/sw/share/nix-ld/lib" | (unset) | "" (b) |
2 | (unset) | "/some/lib" | (unset) | "/some/lib:/run/current-system/sw/share/nix-ld/lib" | (unset) | "/some/lib" |
3 | "/some/nix/ld/lib" | (unset) | (unset) | "/some/nix/ld/lib" | "/some/nix/ld/lib" | (unset) |
4 | "/some/nix/ld/lib" | "/some/lib" | "/some/nix/ld/lib" | "/some/lib:/some/nix/ld/lib" | "/some/nix/ld/lib" | "/some/lib" |
(a) On X86-64 and AArch64 only (see src/arch.rs
). On other platforms, the "Seen by ld.so" state will persist.
(b) The variable will be present but set to an empty string.
- nix-ld was originally written by Mic92 in 2020
- @zhaofengli create a new project based on the idea, called nix-ld-rs in 2023
- Later nix-ld-rs was merged into nix-ld in 2024