Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add USE flags for nss-pam-ldapd and sssd #199

Merged
merged 4 commits into from
Apr 16, 2024

Conversation

bedroge
Copy link
Collaborator

@bedroge bedroge commented Feb 27, 2024

Required by EESSI/gentoo-overlay#99. Note that it also removes a bunch of host symlinks that are no longer required due to the changes in both PRs.

This solves https://gitlab.com/eessi/support/-/issues/32, as it will make use of the host daemons.

Copy link

eessi-bot bot commented Feb 27, 2024

Instance eessi-bot-mc-aws is configured to build:

  • arch x86_64/generic for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/generic for repo eessi-hpc.org-2023.06-software
  • arch x86_64/generic for repo eessi.io-2023.06-compat
  • arch x86_64/generic for repo eessi.io-2023.06-software
  • arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/intel/haswell for repo eessi-hpc.org-2023.06-software
  • arch x86_64/intel/haswell for repo eessi.io-2023.06-compat
  • arch x86_64/intel/haswell for repo eessi.io-2023.06-software
  • arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/intel/skylake_avx512 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-compat
  • arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-software
  • arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/amd/zen2 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/amd/zen2 for repo eessi.io-2023.06-compat
  • arch x86_64/amd/zen2 for repo eessi.io-2023.06-software
  • arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-compat
  • arch x86_64/amd/zen3 for repo eessi-hpc.org-2023.06-software
  • arch x86_64/amd/zen3 for repo eessi.io-2023.06-compat
  • arch x86_64/amd/zen3 for repo eessi.io-2023.06-software
  • arch aarch64/generic for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/generic for repo eessi-hpc.org-2023.06-software
  • arch aarch64/generic for repo eessi.io-2023.06-compat
  • arch aarch64/generic for repo eessi.io-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi-hpc.org-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi.io-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi.io-2023.06-software
  • arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-compat
  • arch aarch64/neoverse_v1 for repo eessi-hpc.org-2023.06-software
  • arch aarch64/neoverse_v1 for repo eessi.io-2023.06-compat
  • arch aarch64/neoverse_v1 for repo eessi.io-2023.06-software

@bedroge
Copy link
Collaborator Author

bedroge commented Apr 15, 2024

The script added in commit 8523330 will apply all those changes. I've run it in our build container, and this is the (expected) difference in packages:

diff in installed packages:
--- /tmp/tmp.nACeZhs5wv/installed-pkgs-pre-update.txt	2024-04-15 13:26:59.806934026 +0200
+++ /tmp/tmp.nACeZhs5wv/installed-pkgs-post-update.txt	2024-04-15 14:08:54.713948610 +0200
@@ -244,12 +244,13 @@
 net-misc/curl-8.3.0-r2::gentoo
 net-misc/rsync-3.2.7-r2::gentoo
 net-misc/wget-1.21.4::gentoo
+net-nds/openldap-2.6.6::gentoo
 perl-core/File-Temp-0.231.100::gentoo
 sys-apps/acl-2.3.1-r2::gentoo
 sys-apps/archspec-0.2.1::eessi
 sys-apps/attr-2.5.1-r2::gentoo
 sys-apps/baselayout-2.13-r1::gentoo
-sys-apps/coreutils-9.3-r1::gentoo
+sys-apps/coreutils-9.3-r3::gentoo
 sys-apps/dbus-1.15.6::gentoo
 sys-apps/debianutils-5.7::gentoo
 sys-apps/diffutils-3.10::gentoo
@@ -272,10 +273,12 @@
 sys-apps/sed-4.9::gentoo
 sys-apps/systemd-utils-253.5::gentoo
 sys-apps/texinfo-7.0.3::gentoo
-sys-apps/util-linux-2.38.1-r2::gentoo
+sys-apps/util-linux-2.38.1-r3::gentoo
 sys-apps/which-2.21::gentoo
+sys-auth/nss-pam-ldapd-0.9.12-r2::eessi
 sys-auth/pambase-20220214::gentoo
 sys-auth/passwdqc-2.0.2-r1::gentoo
+sys-auth/sssd-2.8.2::eessi
 sys-cluster/lmod-8.7.23::gentoo
 sys-cluster/rdma-core-45.0::gentoo
 sys-devel/bc-1.07.1-r6::gentoo

Note that it also recompiles glibc, adds some additional configuration, and bumps the commit used for the EESSI overlay (in order to get the changes from EESSI/gentoo-overlay#99).

This is the output from running some of the affected commands:

$ last

wtmp begins Mon Dec  5 01:00:00 2022

$ who
$ 

Note that it looks like who still doesn't work, but that's because of the container, and the who from the container itself gives the same result. Even more important is the following, which shows that the correct paths are now picked up by these tools:

$ strace who 2>&1 | grep "[u,w]tmp"
access("/var/run/utmpx", F_OK)          = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/var/run/utmp", O_RDONLY|O_CLOEXEC) = 3

$ strace last 2>&1 | grep "[u,w]tmp"
openat(AT_FDCWD, "/var/log/wtmp", O_RDONLY) = 3
write(1, "\nwtmp begins Mon Dec  5 01:00:00"..., 38
wtmp begins Mon Dec  5 01:00:00 2022

The same changes have been deployed to the pilot repo, and tests with LDAP showed that this works fine now. See https://gitlab.com/eessi/support/-/issues/32 for some more details.

Copy link
Contributor

@trz42 trz42 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work! Well documented and tested.

@trz42 trz42 merged commit 1c62ad0 into EESSI:main Apr 16, 2024
3 checks passed
@bedroge bedroge deleted the sssd_nss_use_flags branch April 16, 2024 07:50
@bedroge
Copy link
Collaborator Author

bedroge commented Apr 16, 2024

I've run the update script on both architectures, this is the (same) diff for both of them:

diff for x86_64
diff in installed packages:
--- /tmp/tmp.yPsjSzedQy/installed-pkgs-pre-update.txt	2024-04-16 07:49:15.661591371 +0000
+++ /tmp/tmp.yPsjSzedQy/installed-pkgs-post-update.txt	2024-04-16 08:00:55.035870582 +0000
@@ -244,12 +244,13 @@
 net-misc/curl-8.3.0-r2::gentoo
 net-misc/rsync-3.2.7-r2::gentoo
 net-misc/wget-1.21.4::gentoo
+net-nds/openldap-2.6.6::gentoo
 perl-core/File-Temp-0.231.100::gentoo
 sys-apps/acl-2.3.1-r2::gentoo
 sys-apps/archspec-0.2.1::eessi
 sys-apps/attr-2.5.1-r2::gentoo
 sys-apps/baselayout-2.13-r1::gentoo
-sys-apps/coreutils-9.3-r1::gentoo
+sys-apps/coreutils-9.3-r3::gentoo
 sys-apps/dbus-1.15.6::gentoo
 sys-apps/debianutils-5.7::gentoo
 sys-apps/diffutils-3.10::gentoo
@@ -272,10 +273,12 @@
 sys-apps/sed-4.9::gentoo
 sys-apps/systemd-utils-253.5::gentoo
 sys-apps/texinfo-7.0.3::gentoo
-sys-apps/util-linux-2.38.1-r2::gentoo
+sys-apps/util-linux-2.38.1-r3::gentoo
 sys-apps/which-2.21::gentoo
+sys-auth/nss-pam-ldapd-0.9.12-r2::eessi
 sys-auth/pambase-20220214::gentoo
 sys-auth/passwdqc-2.0.2-r1::gentoo
+sys-auth/sssd-2.8.2::eessi
 sys-cluster/lmod-8.7.23::gentoo
 sys-cluster/rdma-core-45.0::gentoo
 sys-devel/bc-1.07.1-r6::gentoo
diff for aarch64
diff in installed packages:
--- /tmp/tmp.SmTRkm2rb9/installed-pkgs-pre-update.txt	2024-04-16 07:49:19.445369083 +0000
+++ /tmp/tmp.SmTRkm2rb9/installed-pkgs-post-update.txt	2024-04-16 07:58:40.506902840 +0000
@@ -244,12 +244,13 @@
 net-misc/curl-8.3.0-r2::gentoo
 net-misc/rsync-3.2.7-r2::gentoo
 net-misc/wget-1.21.4::gentoo
+net-nds/openldap-2.6.6::gentoo
 perl-core/File-Temp-0.231.100::gentoo
 sys-apps/acl-2.3.1-r2::gentoo
 sys-apps/archspec-0.2.1::eessi
 sys-apps/attr-2.5.1-r2::gentoo
 sys-apps/baselayout-2.13-r1::gentoo
-sys-apps/coreutils-9.3-r1::gentoo
+sys-apps/coreutils-9.3-r3::gentoo
 sys-apps/dbus-1.15.6::gentoo
 sys-apps/debianutils-5.7::gentoo
 sys-apps/diffutils-3.10::gentoo
@@ -272,10 +273,12 @@
 sys-apps/sed-4.9::gentoo
 sys-apps/systemd-utils-253.5::gentoo
 sys-apps/texinfo-7.0.3::gentoo
-sys-apps/util-linux-2.38.1-r2::gentoo
+sys-apps/util-linux-2.38.1-r3::gentoo
 sys-apps/which-2.21::gentoo
+sys-auth/nss-pam-ldapd-0.9.12-r2::eessi
 sys-auth/pambase-20220214::gentoo
 sys-auth/passwdqc-2.0.2-r1::gentoo
+sys-auth/sssd-2.8.2::eessi
 sys-cluster/lmod-8.7.23::gentoo
 sys-cluster/rdma-core-45.0::gentoo
 sys-devel/bc-1.07.1-r6::gentoo

I'm building the tarballs now, so staging PRs should appear soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Install libnss packages in compat layer (instead of making host symlinks)
2 participants