Originally only 2 survived the war - the one from Dalek and the Emperor. The Cult of Skaro fled during the war with the Genesis Ark and Davros was pulled out by Caan. The rest were all made afterwards.
Then Moffat came along and had some magically appear with no explanation.
As for the Timelords, there will be more popping up. It's inevitable.