Please add a setting in gpg.conf to ignore card serial number and try to
decrypt/sign using the connected card. so that we can use different yubikeys
containing same subkeys.

I am actually using multiple yubikeys having same subkeys as a shared key for my
family. we share same laptop but use different tokens containing same subkeys.
the master key is offline.

The problem now is we can only use one token and gpg2 will not allow other
tokens to use even if they have same subkeys :(