Location. The Old Vicarage is located in Ely and attractions in the region include Babylon Gallery Ely Cathedral and Oliver Cromwell's House.