Page MenuHome GnuPG

2.2.16: test suite fails
Closed, ResolvedPublic

Description

+ /usr/bin/make -O -j48 V=1 VERBOSE=1 check
Making check in m4
make[1]: Nothing to be done for 'check'.
Making check in common
/usr/bin/make  check-am
/usr/bin/make  check-TESTS
make[3]: Entering directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/common'
PASS: t-stringhelp
PASS: t-timestuff
PASS: t-convert
PASS: t-percent
PASS: t-gettime
PASS: t-sysutils
PASS: t-sexputil
    > Known envvars: GPG_TTY(ttyname) TERM(ttytype) DISPLAY(display)
    > XAUTHORITY(xauthority) XMODIFIERS GTK_IM_MODULE DBUS_SESSION_BUS_ADDRESS
    > QT_IM_MODULE INSIDE_EMACS PINENTRY_USER_DATA(pinentry-user-data)
PASS: t-session-env
PASS: t-openpgp-oid
PASS: t-ssh-utils
PASS: t-mapstrings
PASS: t-zb32
PASS: t-mbox-util
PASS: t-iobuf
PASS: t-strlist
PASS: t-name-value
PASS: t-ccparray
PASS: t-recsel
PASS: t-exechelp
PASS: t-exectool
===================
All 20 tests passed
===================
error running '/bin/false': exit status 1
make[3]: Leaving directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/common'
Making check in kbx
make[1]: Nothing to be done for 'check'.
Making check in g10
/usr/bin/make  check-TESTS
make[2]: Entering directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/g10'
PASS: t-rmd160
PASS: t-keydb
PASS: t-keydb-get-keyblock
PASS: t-stutter
==================
All 4 tests passed
==================
make[2]: Leaving directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/g10'
Making check in sm
make[1]: Nothing to be done for 'check'.
Making check in agent
/usr/bin/make  check-TESTS
make[2]: Entering directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/agent'
PASS: t-protect
=============
1 test passed
=============
make[2]: Leaving directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/agent'
Making check in scd
make[1]: Nothing to be done for 'check'.
Making check in g13
/usr/bin/make  check-TESTS
make[2]: Entering directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/g13'
PASS: t-g13tuple
=============
1 test passed
=============
make[2]: Leaving directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/g13'
Making check in dirmngr
/usr/bin/make  check-TESTS
make[2]: Entering directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/dirmngr'
PASS: t-http-basic
PASS: t-ldap-parse-uri
==================
All 2 tests passed
==================
make[2]: Leaving directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/dirmngr'
Making check in tools
make[1]: Nothing to be done for 'check'.
Making check in po
Making check in doc
/usr/bin/make  check-am
make[2]: Nothing to be done for 'check-am'.
Making check in tests
Making check in gpgscm
/usr/bin/make  check-local
Testing process and IPC primitives... 
 world. 
All good. 
make[3]: Entering directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/tests/gpgscm'
EXEEXT= GPGSCM_PATH=. \
	./gpgscm ./t-child.scm
hellomake[3]: Leaving directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/tests/gpgscm'
Making check in openpgp
PASS: tests/openpgp/setup.scm 
Printing the GPG version 
PASS: tests/openpgp/version.scm 
Checking armor encoding and decoding 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
PASS: tests/openpgp/enarmor.scm 
Hashing the empty string 
    > MD5 SHA1 RIPEMD160 SHA224 SHA256 SHA384 SHA512 <  
Hashing the string "abcdefghijklmnopqrstuvwxyz" 
    > MD5 SHA1 RIPEMD160 SHA224 SHA256 SHA384 SHA512 <  
PASS: tests/openpgp/mds.scm 
Checking decryption of supplied files 
    > plain-1 plain-2 plain-3 plain-large <  
PASS: tests/openpgp/decrypt.scm 
Checking decryption of supplied files using --multifile. 
Verifying files: 
    > plain-1 plain-2 plain-3 plain-large <  
PASS: tests/openpgp/decrypt-multifile.scm 
Checking decryption of supplied DSA encrypted file 
    > plain-1 <  
PASS: tests/openpgp/decrypt-dsa.scm 
Checking decryption of supplied files using the session key. 
    > plain-1 plain-2 plain-3 plain-large <  
PASS: tests/openpgp/decrypt-session-key.scm 
Checking unwrapping the encryption. 
    > encsig-2-keys-3 encsig-2-keys-4 <  
PASS: tests/openpgp/decrypt-unwrap-verify.scm 
Checking signing with the default hash algorithm 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
Checking signing with a specific hash algorithm 
    > SHA1 RIPEMD160 SHA256 SHA384 SHA512 SHA224 <  
PASS: tests/openpgp/sigs.scm 
Checking signing using DSA with the default hash algorithm 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
Checking signing using DSA with a specific hash algorithm 
    > SHA1 RIPEMD160 <  
PASS: tests/openpgp/sigs-dsa.scm 
Checking encryption 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
Checking encryption using a specific cipher algorithm 
    > IDEA ........ 3DES ........ CAST5 ........ BLOWFISH ........ AES ........ AES192 ........ AES256 ........ TWOFISH ........ CAMELLIA128 ........ CAMELLIA192 ........ CAMELLIA256 ........ <  
Checking encryption using a key from file 
    > plain-1 plain-2 plain-3 plain-large <  
PASS: tests/openpgp/encrypt.scm 
Checking encryption of supplied files using --multifile. 
Verifying files: 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
PASS: tests/openpgp/encrypt-multifile.scm 
Checking encryption using DSA 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
Checking encryption using DSA and a specific cipher algorithm 
    > IDEA ........ 3DES ........ CAST5 ........ BLOWFISH ........ AES ........ AES192 ........ AES256 ........ TWOFISH ........ CAMELLIA128 ........ CAMELLIA192 ........ CAMELLIA256 ........ <  
PASS: tests/openpgp/encrypt-dsa.scm 
Checking encryption using a specific compression algorithm 
    > Uncompressed ........ ZIP ........ ZLIB ........ BZIP2 ........ <  
PASS: tests/openpgp/compression.scm 
Checking encryption, signing, and producing armored output 
    > plain-1 plain-2 plain-3 plain-large <  
PASS: tests/openpgp/seat.scm 
Checking signing and verifying plain text messages 
    > plain-1 plain-2 plain-3 plain-large plain-large <  
Checking signing and verifying test vectors 
    > 0 1 2 3 4 5 <  
PASS: tests/openpgp/clearsig.scm 
Checking encryption and decryption using pipes 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
PASS: tests/openpgp/encryptp.scm 
Checking detached signatures 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
PASS: tests/openpgp/detach.scm 
Checking detached signatures of multiple files 
PASS: tests/openpgp/detachm.scm 
Checking armored signatures 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
PASS: tests/openpgp/armsigs.scm 
Checking armored encryption 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
PASS: tests/openpgp/armencrypt.scm 
Checking armored encryption and decryption using pipes 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
PASS: tests/openpgp/armencryptp.scm 
Checking signing and encryption 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
Checking bug 537: MDC problem with old style compressed packets. 
PASS: tests/openpgp/signencrypt.scm 
Checking signing and encryption using DSA 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
Checking signing and encryption using DSA with a specific hash algorithm 
    > SHA1 RIPEMD160 <  
PASS: tests/openpgp/signencrypt-dsa.scm 
Checking armored signing and encryption 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
PASS: tests/openpgp/armsignencrypt.scm 
Checking armored detached signatures 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
PASS: tests/openpgp/armdetach.scm 
Checking armored detached signatures of multiple files 
PASS: tests/openpgp/armdetachm.scm 
Checking batch key generation 
PASS: tests/openpgp/genkey1024.scm 
Checking conventional encryption 
    > plain-2 data-32000 <  
Checking conventional encryption using a specific cipher 
    > IDEA .. 3DES .. CAST5 .. BLOWFISH .. AES .. AES192 .. AES256 .. TWOFISH .. CAMELLIA128 .. CAMELLIA192 .. CAMELLIA256 .. <  
PASS: tests/openpgp/conventional.scm 
Checking conventional encryption with MDC 
    > IDEA .. 3DES .. CAST5 .. BLOWFISH .. AES .. AES192 .. AES256 .. TWOFISH .. CAMELLIA128 .. CAMELLIA192 .. CAMELLIA256 .. <  
Checking sign+symencrypt 
    > plain-1 plain-2 plain-3 plain-large data-500 data-9000 data-32000 data-80000 <  
PASS: tests/openpgp/conventional-mdc.scm 
Checking that a valid signature is verified as such 
    > sig-sl-valid <  
Checking that an invalid signature is verified as such 
    > sig-1ls1ls-valid sig-ls-valid sig-1lsls-invalid sig-lsls-invalid sig-lss-invalid sig-slsl-invalid <  
PASS: tests/openpgp/multisig.scm 
Checking bogus signature 
    > #x2d #xca <  
Checking that a valid signature is verified as such 
    > msg_ols_asc msg_cols_asc msg_sl_asc msg_oolss_asc msg_cls_asc msg_clss_asc <  
Checking that a valid signature over multiple messages is verified as such 
    > msg_olsols_asc_multiple msg_clsclss_asc_multiple <  
Checking that an invalid signature is verified as such 
    > bad_ls_asc bad_fols_asc bad_olsf_asc bad_ools_asc <  
Checking that a valid Ed25519 signature is verified as such 
    > msg_ed25519_rshort msg_ed25519_sshort <  
PASS: tests/openpgp/verify.scm 
Checking verification of supplied files using --multifile. 
PASS: tests/openpgp/verify-multifile.scm 
Checking bogus signature 
    > #x2d #xca <  
Checking that a valid signature is verified as such 
    > msg_ols_asc msg_cols_asc msg_sl_asc msg_oolss_asc msg_cls_asc msg_clss_asc <  
Checking that an invalid signature is verified as such 
    > bad_ls_asc bad_fols_asc bad_olsf_asc bad_ools_asc <  
Checking that a valid Ed25519 signature is verified as such 
    > msg_ed25519_rshort msg_ed25519_sshort <  
PASS: tests/openpgp/gpgv.scm 
Checking that a signature by bad key should not be verified 
    > msg_signed_asc <  
PASS: tests/openpgp/gpgv-forged-keyring.scm 
Checking armored_key_8192 
Importing alpha_seckey 
(((/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/g10/gpg --no-permission-warning --always-trust --output - --import -) 15217 2))
FAIL: tests/openpgp/armor.scm 
Checking bug 894: segv importing certain keys. 
Checking bug 1223: designated revoker sigs are not properly merged. 
Checking import of two keys with colliding long key ids. 
PASS: tests/openpgp/import.scm 
Checking key revocation. 
PASS: tests/openpgp/import-revocation-certificate.scm 
Preparing for ECC test 
Importing ECC public keys 
Checking opaque ECDSA signatures 
    > msg_opaque_signed_256 msg_opaque_signed_384 msg_opaque_signed_521 <  
Importing ECC secret keys 
("/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/g10/gpg" --import "/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/tests/openpgp/samplekeys/ecc-sample-1-sec.asc") failed: gpg: importing secret keys not allowed
gpg: Total number pmake[2]: Entering directory '/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/tests/openpgp'
LC_ALL=C EXEEXT= PATH=../gpgscm:/home/tkloczko/.local/bin:/home/tkloczko/bin:/usr/share/Modules/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin abs_top_srcdir=/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16 objdir=/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16 GPGSCM_PATH=/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/tests/gpgscm /home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/tests/gpgscm/gpgscm \
  /home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/tests/openpgp/run-tests.scm  
rocessed: 1
gpg:       secret keys read: 1

FAIL: tests/openpgp/ecc.scm 
PASS: tests/openpgp/4gb-packet.scm 
Checking tofu policies and trust... 
Setting a fixed policy... 
    > good ..... unknown ..... bad ..... <  
Checking TOFU stats...
Checking cross sigs...
    > Two keys. <
    > Adding cross signatures. <
    > Adding conflicting user id. <
    > Adding cross signature on user id. <
Checking UTK sigs...
    > Two keys. <
    > Adding cross signatures. <
    > Marking 1938C3A0E4674B6C217AC0B987DB2814EC38277E as ultimately trusted. <
    > Adding conflicting user id. <
    > Adding cross signature on user id. <
PASS: tests/openpgp/tofu.scm 
Checking basic WoT (classic trust model)...
PASS: tests/openpgp/trust-pgp-1.scm 
Checking WoT with trust signatures (PGP trust model)...
PASS: tests/openpgp/trust-pgp-2.scm 
Checking max depth of trust signature chains...
PASS: tests/openpgp/trust-pgp-3.scm 
Checking gpgtar without encryption 
Checking gpgtar without encryption with nicer actions 
Checking gpgtar with asymmetric encryption 
Checking gpgtar with asymmetric encryption and signature 
Checking gpgtar with signature 
Checking gpgtar with symmetric encryption 
Checking gpgtar with symmetric encryption and chosen cipher 
Checking gpgtar with both symmetric and asymmetric encryption 
PASS: tests/openpgp/gpgtar.scm 
Importing public key. 
Checking that the most recent, valid signing subkey is used by default 
    > 8BC90111 3E880CFF F5F77B83 45117079 1EA97479 <  
Checking that we can select a specific signing key 
    > 8BC90111 F5F77B83 1EA97479 <  
PASS: tests/openpgp/use-exact-key.scm 
Importing public key. 
Checking that the most recent, valid signing subkey is used by default 
    > 8BC90111 3E880CFF F5F77B83 45117079 1EA97479 <  
Checking that the most recent, valid encryption subkey is used by default 
    > 8BC90111 3E880CFF F5F77B83 45117079 1EA97479 <  
PASS: tests/openpgp/default-key.scm 
Checking key export 
    > D74C5F22 (((/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/g10/gpg --no-permission-warning --always-trust --output - --list-packets -) 15877 2) ((/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/g10/gpg --no-permission-warning --always-trust --output - --export-secret-keys D74C5F22 -) 15876 2))
FAIL: tests/openpgp/export.scm 
Importing ssh keys... 
    > dsa rsa ecdsa ed25519 <  
Checking for issue2316... 
PASS: tests/openpgp/ssh-import.scm 
Checking ssh export... 
("/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/g10/gpg" --no-permission-warning --always-trust --yes --import "/home/tkloczko/rpmbuild/BUILD/gnupg-2.2.16/tests/openpgp/samplekeys/authenticate-only.sec.asc") failed: gpg: keybox '/tmp/gpgscm-20190702T065722-run-tests-IbD3KD/pubring.kbx' created
gpg: importing secret keys not allowed
gpg: Total number processed: 1
gpg:       secret keys read: 1

0: tests.scm:122: (throw (string-append (stringify what) " failed") (:stderr result))
1: ssh-export.scm:44: (call-check `(,@gpg --yes --import ,(:file key)))
FAIL: tests/openpgp/ssh-export.scm 
Checking quick key generation... 
Checking that we can add a user ID... 
Checking that we can mark an user ID as primary. 
Checking that we get an error making non-existent user ID the primary one. 
Checking that we can revoke a user ID... 
Checking that we get an error revoking a non-existent user ID. 
Checking that we get an error revoking the last valid user ID. 
Checking that we can change the expiration time. 
Checking that we can add subkeys... 
    > () (- - -) (default default never) (rsa sign auth encr seconds=600) (rsa auth,encr 2) (rsa sign 2038-01-01) (rsa sign 20380101T115500) (rsa sign 2d) (rsa1024 sign 2w) (rsa2048 encr 2m) (rsa4096 sign,auth 2y) (future-default) <  
PASS: tests/openpgp/quick-key-manipulation.scm 
Checking key selection 
    > 5 4 4 3 4 3 3 2 4 3 3 2 3 2 2 1 4 3 3 2 3 2 2 1 3 2 2 1 2 1 1 <  
PASS: tests/openpgp/key-selection.scm 
PASS: tests/openpgp/delete-keys.scm 
Checking reading and writing configuration via gpgconf...  
    > keyserver ............. verbose ............. quiet ............. <  
PASS: tests/openpgp/gpgconf.scm 
Checking passphrase cache (issue2015)... 
PASS: tests/openpgp/issue2015.scm 
Checking import statistics (issue2346)... 
gpg: keybox '/tmp/gpgscm-20190702T065740-run-tests-MK8uDJ/pubring.kbx' created
gpg: importing secret keys not allowed
gpg: Total number processed: 1
gpg:       secret keys read: 1

0: tests.scm:129: (throw (:stderr result))
1: issue2346.scm:26: (call-popen `(,@gpg --status-fd=1 --import ,key) "")
FAIL: tests/openpgp/issue2346.scm 
Checking robustness wrt empty databases in gnupghome (issue2417)... 
PASS: tests/openpgp/issue2417.scm 
Checking iobuf_peek corner case (issue2419)... 
PASS: tests/openpgp/issue2419.scm 
Checking TOFU trust model with ultimately trusted keys (issue2929). 
PASS: tests/openpgp/issue2929.scm 
Checking invocation with invalid file descriptors (issue2941). 
    > status-fd attribute-fd logger-fd override-session-key-fd passphrase-fd command-fd <  
PASS: tests/openpgp/issue2941.scm 
=================== 
60 tests run, 55 succeeded, 5 failed, 0 failed expectedly, 0 succeeded unexpectedly, 0 skipped. 
Failed tests: tests/openpgp/issue2346.scm tests/openpgp/ssh-export.scm tests/openpgp/export.scm tests/openpgp/ecc.scm tests/openpgp/armor.scm 
===================

Details

Version
2.2.16

Event Timeline

Please share with us the OS used, the versions of the libtaries used and other configuration information.
Also please run again using "make check" without any extra options.

[tkloczko@barrel SPECS]$ uname -a
Linux barrel 5.1.5-300.fc30.x86_64 #1 SMP Sat May 25 18:00:11 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
[tkloczko@barrel SPECS]$ rpm -q libassuan-devel libcurl-devel libgcrypt-devel libgpg-error-devel libksba-devel libusb-devel npth-devel openldap-devel pcsc-lite-libs gnutls-devel sqlite-devel
libassuan-devel-2.5.3-2.1.fc31.x86_64
libcurl-devel-7.65.1-2.fc31.x86_64
libgcrypt-devel-1.8.4-4.1.fc31.x86_64
libgpg-error-devel-1.36-2.fc31.x86_64
libksba-devel-1.3.5-10.1.fc31.x86_64
libusb-devel-0.1.5-14.fc30.x86_64
npth-devel-1.6-3.fc31.x86_64
openldap-devel-2.4.47-2.2.fc31.x86_64
pcsc-lite-libs-1.8.25-2.1.fc31.x86_64
gnutls-devel-3.6.8-2.fc31.x86_64
sqlite-devel-3.28.0-2.fc31.x86_64

Still about half of the packages are from Fedora rawhide but rest are mine.
Just checked and the test suite fails exactly the same way even started without palatalisation.

werner added a project: Fedora.

Thanks. You may want to ask on the mailing list gnupg-users to see whether someone else has had problems building on rawhide. Right now we do not have the time for individual support and thus I unfortunately need to prioritize this bug report down.

I cannot do that because all listed above packages are my own products.
Fedora is not execution test suites in more than 90% of all packages so they are not aware of most of the issues exposed by test suites.
Please focus on possible causes of above tests.
I'm opened on any suggestions to make additional diagnostics.

Additionally because only recently I've started adding %check section I can tell you that prev version of the gnupg2 2.2.15 fails exactly the same way.

kloczek claimed this task.

Just checked 2.4.1 and looks like now everything is OK.

Closing.