Perhaps they used caulk but the correct way is with epoxy thinset and grout. It is not a job for the faint-hearted....approach it after you've done your homework and are comfortable with the project.