At the priory, there is a small (18 feet by 12 feet) chapel, the Oratory of St Mary or Percy Chapel. Notable decorative features include a painted ceiling with numerous coats of arms and other symbols, stained glass side windows, and a small rose window in the east wall, above the altar:
