If you have a number pad on your computer, make sure numlock is enabled. Then press your ALT key simultaneously with the '3' on your numpad. Then you'll get ♥. It doesn't work with the '3' above your qwerty, you really need a numpad. But you could always just use CTRL C and CRTL V, like you must have done in your question.
Hope this helps!
p.s. You can also find ♥ in the symbol list of Word!
ALT 1=☺
ALT2=☻
ALT3=♥
ALT4=♦
ALT5=♣
ALT6=♠
ALT7=•
ALT8=◘
ALT9=○
☺☻♥♦♣♠•◘○☺☻♥♦♣♠•◘○☺☻♥♦♣♠•◘○☺☻♥♦♣♠•◘○☺☻♥♦♣♠•◘○
.......COOOOOOL.....i just figured these out by playing around........neato....