This is a spin-off of T6240: Kleopatra: Add column for groups in the certificate view:
if you edit a group and move keys down then they should be removed from the upper list of available keys so that it is easily visible which keys in your keyring are not part of a specific group.