On windows it is possible to delete $GNUPGHOME while gpg-agent is running, and the agent dies shortly afterwards.
But when dirmgnr is running this is no longer possible as dirmngr keeps file handles open.
I do not think that this is necessary. But it is not a big issue.