Always treat time_t as an unsigned 32-bit number
All time fields in OpenPGP are unsigned four-octet numbers.