"gpg --import" should only need the gpg-agent if a secret key is being imported,
but it appears to auto-launch the agent even if it's just importing a public key.
This results in unnecessary gpg-agent processes on systems that don't expect to
ever deal with secret key material.