We have one rail that's always more stubborn to remove than the others. My husband uses a rubber mallot on the underside of the top of the rail. He has to pound fairly hard several times, but at least it doesn't do any damage at all.