thats what i do... and its worked out pretty well so far. to put them back in, i generally place the arm on a hard surface, line up the arm 'stud' with the hole in the minifig's body, and press down really hard.
p.s. and if it does break, please do not hold me responsible