Yes, taking the foam out and using a sock will work good too. I wouldn't carry your firearm in the trunk of a car without some type of padding, but in the house would probably work fine.
