Call at most save once per config module

Previously when changing a module multiple time, the save method would
be called the same amount of time because after each change we would add
the module to the list of changed modules.