Speed up compilation

We don't need to make the source public otherwise they are compiled for
each unit test