speedo: Do not use the gpg-error-config in the build system
With that installed we don't get proper suport for SYSROOT.