On its Wikipedia-page, it says:
“The Voyager Program was similar to the Planetary Grand Tour planned during the late 1960s and early 70s. The Grand Tour would take advantage of an alignment of the outer planets discovered by Gary Flandro, an aerospace engineer at the Jet Propulsion Laboratory. This alignment, which occurs once every 175 years, would occur in the late 1970s and make it possible to use gravitational assists to explore Jupiter, Saturn, Uranus, Neptune, and Pluto. The Planetary Grand Tour was to send several pairs of probes to fly by all the outer planets (including Pluto, then still considered a planet) along various trajectories, including Jupiter-Saturn-Pluto and Jupiter-Uranus-Neptune. Limited funding ended the Grand Tour program, but elements were incorporated into the Voyager Program, which fulfilled many of the flyby objectives of the Grand Tour except a visit to Pluto.”
Translation: Space is vast. Traveling through it and hitting your target is difficult.
Strangely, all it takes to understand that is school physics.