The safe houses were nice, but one couldn't spend the whole week in them. Levi, for one, got restless and felt the need to move around. Or maybe he just wanted to get his frustration at this place out by killing monsters, since it was one of the few things that made him feel useful here. So it didn't really matter to him why Silco wanted to travel between one safe house and another, he was more than willing to escort his boss.