Permission
The access and action limits software enforces for an AI, including when a person must approve an action.
Permissions are the limits software enforces on what an AI can read, change or do. They can also require a person to approve an action before it happens. The product and the systems it connects to enforce these limits; asking the AI to follow a house rule is a different kind of control.
Paul and Linda Carter have separate advisers after their divorce. At Linda's request, an administrator restricts her back-office record to her adviser. Later, a trainee asks the firm's AI product to draft Paul a letter about his pension after the pension sharing order. The draft mentions Linda's new income. The trainee cannot open Linda's record to check it. The product's log shows that it retrieved that information from her record.
The principal connected the product to the back office using a login that opens every record. The product reused that connection for the trainee's request, so the trainee's own restriction did not apply. A firm can restrict a person's login and still expose more records through a shared AI connection. The firm needs to check which login the product uses and whether it checks the access of the person asking.
Not to be confused with
- Instructions are directions written for the AI, such as a house rule typed into the product's settings. Software enforces a permission even if the AI ignores an instruction.
- Human review means a person checks the AI's work against its sources. A permission can make an action wait for someone to approve it, but approving the action is not checking the work. Inside its permissions, the AI can still get things wrong.
- Permission, in this entry, means a software access limit. It does not mean a client's consent.
Overheard
How did the AI know Linda's taking an income? I can't even open her record.
It was signed in to the back office as me, so it had my permissions, not yours. I've disconnected it until we can show it cannot open records you cannot.
Where it sits
Permission
- is part ofHarness
- works withAI-nativeWhere client data goesInstructionsToolAgentHuman review
Copy this entry
Paste it into Word, Google Docs, Notion or Apple Notes. Headings and links come with it.
Sources
Your feedback
Could you explain permission to a colleague now?