I'm pretty sure they're only visible to party members, but I do recall several instances where I could see another party's door. However, I usually cannot see my bishop's door until I invite my char to the party.
Either way, only the party members can use the door.