Even with sublight travel at 1% light speed, a single technological species with about a hundred years more than us can colonize the entire galaxy by hopping around, filling a new planet in 5000 year, and then going again, in about a dozen million years. That's the essence of Fermi's "paradox"...