According to our current cosmological models, the very early universe was featureless and dark, with the first gas clouds capable of forming stars only appearing between 100 million to 250 million years after the Big Bang. Thus, we can reasonably infer that the first stars only appeared about 100 million years after the Big Bang, nearly a billion years before galaxies proliferated across the cosmos.
Now, the early universe was also characterized by very high densities and non-uniform conditions that could have led sufficiently dense regions to undergo gravitational collapse, thus forming black holes. These hypothetical structures, called primordial black holes (PBHs), are thought to have formed soon after the Big Bang. Interestingly, since PBHs did not form from the gravitational collapse of stars, their masses can be much lower than typical stellar masses.
Thus, in conclusion, black holes - most likely - have formed before stars!