Hummingbirds are like magic--so fast and fleeting, so tiny. I don't know of any old wive's tales that support the idea, but I think they bring good luck. I can't imagine not wanting them in the garden.
What attracts hummingbirds? The easy answer is nectar-rich plants, preferably with bright flowers. Taller plants and shrubs make it easier for the little birds, but they will come closer to the earth when the nectar is plentiful.

In the spring hummingbirds migrate back to cold winter climates and appreciate red or yellow columbines. Later on they are attracted to salvia, monarda, butterfly weed (Asclepias), penstemon, agastache ("hummingbird mint") and yucca. Trumpet vine (Campsis radicans) is a favorite.
In the shrub department, hummers dote on butterfly bush (Buddleia). Howver, in some areas, butterfly bush is considered invasive. Check with your county extension agent fo find out if butterfly bush is a problem where you live.
Rose of Sharon (Hibiscus syriacus) is tough, beautiful and floriferous. Grow one or two as either shrubs or small trees and your local hummers may take notice.
If you really want hummingbirds (or butterflies, "regular" birds or pollinating insects), garden as organically as possible. Pesticides disrupt the food chain and discourage beneficial species. Somehow the bad bugs always find a way, no matter what you do. I can live with a few aphids, but I would hate to lose my hummers.