I dont thick it wil hurt to clean the holes out. Ive put in new flywheels and forgot to clean the new paint out with a drill bit and had to thread the bolt through the hole the first time. Its unlikely the holes are off on the converter. Could just be the new paint.