Drop another upper on there just for grins and see if the same happens. If so send those lowers back. If not, maybe the upper might be a bit off?
Should NOT need to machine stuff like this to get it to fit.
I have had them be tight at first. But, never took a tool to one ever.