It doesn't necessarily take a long time for a black hole to forn, just a lot of matter. If enough gaseous matter formed a compact enough sphere, then the gravitational attraction would pull it increasingly inwards, until the point that it formed a black holes. A couple hundred million years shoulld be more than sufficient for some quasars to form, though some probably took longer. Enough infalling matter would create a black hole pretty quickly, though.