Where do these people live in Harry Potter?

After Voldemort was "defeated" the first time when Harry was one he went into hiding in the forest of Albania for 10 years, then he lived on the back of Quirrell's head for one year (inside Hogwarts while he taught there) then he at least spent some time in the old Riddle House where he killed Tom the gardener until he finally set up his headquarters in Malfoy Manor