That area is usually grouted instead of caulked; are you sure it's caulking?