Generally gardeners want to grow Perennials in an effort to grow higher yields of food, and spend no time tilling, or re-planting next year. However, I suggest to continue to re-growing (or Propagating) perennials through dividing or cuttings. This will allow you to increase the number of plants in your garden without purchasing from a big-box-store. 

 "Once the plant's root structure is large enough, you can simply divide it into separate clumps and transplant...In late fall, follow these simple steps:

Determine whether the perennial should be divided: Check out the crown of the plant, which sits right at the soil's surface. If there are multiple crowns where leaves are growing, the plant is ready to divide.

Remove the plant from the soil: Use a shovel to dig around the plant and loosen it from the soil.

Root division: To avoid damaging roots, use a small garden fork to gently untangle the root structure into two clumps. Depending on how big the root structure is, you can continue to divide into smaller clumps.

Transplant: Replant the clumps into the soil, making sure to give each plant enough space to grow. This will depend on how large the expected root structure is - ask your local gardening store if you're unsure. Cover with soil, water and make sure the soil is moist throughout the winter. With luck, the rains should take care of that" (SF Gate). 

Besides dividing plants, gardeners also root plants from cuttings. For example, "Cleanly cut a stem about 3 inches in length off of the plant, at a diagonal and above a node. Remove any leaves so that energy can be redirected into growing roots.

Encourage root growth: Cover the end with a root hormone powder (check your local gardening store) or a natural root stimulant.

Keep moist and warm: If left out in the air, the cutting will dehydrate and shrivel quickly. Dig a wide hole in moist soil, to ensure that the root powder does not scrape off the sides of the cutting as you place it in. Fill in with soil and keep well watered, well drained and warm.

Tug: To determine if the plant is ready to be transplanted into your garden, pull on it. If it pulls back - this time varies from plant to plant, but anywhere from one to four weeks later - you're good to go" (SF Gate). 

According to Becca Badgett, gardeners should choose to grow "delicate and frilly flowers when choosing hardy perennial plants that are members of the Dianthus family, such as Sweet William and carnations. The herb yarrow provides frilly foliage and delicate blooms when used for cold climate gardening" (GardeningKnowHow). Becca Badgett also suggests growing Perennial plants from shortest to tallest around the borders of your home or yard (like in the picture below).

For example, plant  your taller plant in the back, like the Foxglove, Bugbane, Meadowsweet, Sneezeweed; and Echinacea, Delphinium, Aster, Chrysanthemum, False indigo, Tickseed, Bleeding heart, and Globe thistle. Shorter plants for the front of the garden include: Ajuga, Spurge, Sea thrift, and Wormwood.

Here I have provided a list of Common Perennial food, trees and flowers that grow in almost any region:

If you read my post "List of Shade & Cold tolerant plants" from weeks ago, some of the names of Flowers and vegetables may sound familiar. Many of the shade and cold tolerant flowers and vegetables I listed in that post were Perennial plants. For example, Ferns, Hostas, Bee Balm, Viola, Solomon's Seal are Perennial plants that tolerate shade and cold climates. 

Some of the Flowers I listed above are growing in my Grandmother's Perennial Flower garden.  She grows Bee Balm, Butterfly bush, Tulips, Phlox, Iris, Dahlia, and Yarrow. These flowers are cold hardy, growing in Zone 6 (my region) and as cold as USDA Zone 3. I have taken many photos of her flowers, which you can see in this post: Floral Photography 2014.

Edible Landscape Design made an Extended list of other Perennial fruit trees and vegetables I did not mention, which you can see here: A list of Perennials to Get You Started. I highly recommend reading my Extensive list of Uncommon Fruit trees and fruit bushes because it provides a list of Cold Hardy Perennial Foods for Edible Landscaping. Click the link to the article and read how to grow each of these Fruits: List of Uncommon Cold Hardy Fruit Trees (Gardening Zones 3-7).
 

References from GardenGuides, SF Gate, GardeningKnowHow and Permaculture Research Institute.