Looking at that list you have a good reason now to have an untidier garden. Apart from planting attractive plants in the garden, you can also promote ladybug populations by the elimination of spraying insecticides. Not only are ladybugs sensitive to most synthetic insecticides, but if the majority of their food source is gone, they won't lay their eggs in your garden. As difficult as it may be, allowing aphids to live on certain plants is necessary to ensure that there is enough food for ladybugs. In addition, resist the urge to squish bugs & eggs in the garden, unless you're certain that they are not beneficial.
Another beneficial insect for your aphid problem is hoverflies. These you will find either in the ground as lava or in sheltered spots in your garden such as, nooks and crannies of old trees and will come out at the first sign of a warm day searching for aphid infested plants on which to lay their eggs. The lava of this insect has a voracious appetite for aphids.
I had the cheeky little beggars on my patio last week eating the new growth of my Alpine Strawberries but a quick blast of the hose dispersed them not to return. I think we all too quickly sometime run to grab a spray bottle answer when it would be better to be working with nature to strengthen our backyards biome. All things in balance works better. :)