The church at Caister is allegedly haunted by the ghost of a monk who plays the organ. In January 1967 Canon Ernest Pitman, the vicar at the time, decided to find out if the claims were true.

He placed a tape-recorder in the church near the organ one night before leaving and locked the door. The next morning when he played the tape back, he heard footsteps moving across the empty church and clear and loud notes coming from the organ. This was followed by banging noises that had never been heard before.