I could be completely wrong about this, but going off of what I remember from astronomy/physic courses, I don't think this is entirely true.
True, gravity does affect everything but a galaxy millions of light years away doesn't have any noticeable affect on our galaxy. There is some gravitational pull (exponentially insignificant) but the expansion of the universe is a much stronger force. Gravity only affects objects to a certain distance. Much like a comet passing through the solar system can be on an unbound orbit. It passes through once and then never again. Gravity can change the direction of an object but after a certain distance/path of orbit, things will stop orbiting a gravitating object. The gravity of black holes acts no differently (from what I understand).
For example, if you placed a black hole with the same mass as our sun at the middle of the solar system, none of the obits of any of the planets/asteroids/comets/what ever, would change. The only things that would be sucked into the black hole are things that would have crashed into the sun to begin with.
Furthermore, it is extremely difficult to actually fall into a black hole. It's really hard to explain without a diagram but I'll try. First you have to understand that black holes can warp the dimension of space-time. If you picture a flat vector, that would be space time without a black hole. If you placed a black hole in the center of it, the vector would funnel down to a certain point (we don't know what that point is). So imagine a flat piece of paper with a funnel in the middle of it (I hope that's a good image to describe it). Objects can have all sorts of orbits around and into the black hole. Like if the black hole replaced our sun, objects orbiting far enough away wouldn't ever fall into the black hole. Then objects like comets with bound orbits, they would start to fall into the warp of space time (as in they'd start to fall into the funnel), but their orbits would pull them out of it. They'd then return the next time they cycle through. You can go deeper and deeper into a black hole and orbit out of it. The only way you'd fall in is if your orbit actually has it so you crash into the center of mass. Granted that could happen in an infinite number of places, but there's an even larger infinite number of places to be where your orbit actually never crashes into the black hole.
It all depends on the mass of the black hole on whether or not something will crash into it. There are countless black holes throughout the universe no where near massive enough to pull us in.
Granted, it's possible that we are orbiting a massive black hole and are on a path that leads us straight into the worm hole, but that's just a hypothesis. I guess my point is a number of discovered black holes pose absolutely no threat to us.