Mainstage (as well as Logic Pro X) use an auto-save feature that creates backups in the background even while playing.

Since our libraries are big, saving can create hiccups, so the solution is simply to disable the auto-save feature in Mainstage's or Logic's preferences.