When changing the application language in Kleopatra, the language used by Qt does not change. So the Qt Buttons still use the system locale while Kleopatra is in a different language.
To fix that we could somehow read out the language used by Kleopatra on startup and force Qt to use that, too. E.g. by setting the LANG environment variable early inside main.