I realized what's the problem after looking at your file. I set mirrored to my arm sprite which gives it the weird rotation. And then i need to add the 'flip' so that the arm is not upside down when i go left.
Btw, when the mouse is too close to the arm sprite, the 'set angle towards' is not working. Any ways to get past that?