How can I specify remove a person to see the "People" button?

The “Confluence Browse People Permission” App only supports removing/adding the group.

If you want to remove the person, you should following these step:

• Create the group (ex: “view-people-directory”)

• Add all persons without specifying one person to a group (“view-people-directory”)

• Add that group (“view-people-directory”) to the white list - the guide here