That’s normal, as long as it’s less than 1/4" movement.
If you want increased accuracy, I would suggest searching the forum for the set focus feature and the camera calibration process.