From your description of the load, are you talking about to the base of the neck, halfway up the neck or to the rim of the neck??
If you are using a 150 grain flat base or boat tail bullet, you will likely be able to seat your bullet out far enough not to worry about compression.
IMR4064 is quite a forgiving powder. It does very well with a bit of an air space, or just touching the base of the bullet or being slightly compressed.
You don't mention the cartridge case you're using. The charge of IMR4064 you mention will fil milsurp cases to the base of the neck and if there is a cannelure on the bullet, it will just touch the top of the powder column, if seated to that depth.
IMHO, there's nothing wrong with your load.