So, this is a headache when you use Yubikeys or smartcards, but to disable Smartcard support in GUI, you have to remove it from the session environments.
Unfortunately, this causes some headaches, as even if you follow instructions such as those in this question's answers, package updates can occasionally overwrite /usr/share/gnome-session/sessions/gnome-login.session and /usr/share/gnome-session/sessions/ubuntu.session which undo those changes. This bit me in the butt today and it took nearly an hour and a half for me to debug this and get back to a usable state on my 22.04 system.
My solution as an insane power user was to create a SystemD unit needed before graphical.target and forcibly removes the org.gnome.SettingsDaemon.Smartcard references in both files as a perpetual fix during the boot process, but I'm wondering if there's a way to override the session referred to in the boot process so I don't have to alter the files that're overwritten during some updates.
Where does the system get its definitions of what session file to use in sessions, and is it possible for me to override it so that it loads a custom .session file always that will NEVER have the lines that I need to remove in it, thereby not having to go with my 'power user' approach?