Which Debt to Pay Off 1st

When paying off debt, should you pay off the highest interest debt or the one you owe the least on? According to this video on MSN Money, the math says to pay off the highest interest debt first, but motivation says pay off the smallest debt so you have a sense of accomplishment.