Given a config file with:
keyserver x-hkp://pool.sks-keyservers.net
Note that usually --refresh-keys will honor this:
$ /usr/bin/gpg --refresh-keys --keyserver x-hkp://pool.sks-keyservers.net
3BF0E8B3615BF434 D8425D4D2DF2DD84
gpg: refreshing 2 keys from x-hkp://pool.sks-keyservers.net gpg: requesting key 3BF0E8B3615BF434 from hkp server pool.sks-keyservers.net gpg: requesting key D8425D4D2DF2DD84 from hkp server pool.sks-keyservers.net ^C gpg: Interrupt caught ... exiting
However, I found a keyID that causes it to ignore the preference:
$ /usr/bin/gpg --refresh-keys --keyserver x-hkp://pool.sks-keyservers.net
BEB441496300CC3D
gpg: requesting key BEB441496300CC3D from hkp server subkeys.pgp.net ^C gpg: Interrupt caught ... exiting