That's the problem. I don't know if this is an intended behavior: when you use the move command, if you hold down the shift key to get the horizontal or vertical constraint, when your selection is already snapping to something, as you keep holding the shift key, the mouse up and down movements will slightly move the selection to the left or right.