Back to Blog
Ai Software

AI on customer uploads: treat documents as untrusted input

2026-10-13
1 min read
Share :

Uploaded documents can contain instructions aimed at the model. They remain data for the application to process, without granting new authority.

Restrict capabilities

Only permitted documents reach the model. Keep tool credentials and access decisions in controlled application services. Untrusted text cannot expand the authorized workflow.

Test adversarial examples

Include documents that request unrelated access or attempt to override the task. Inspect output and tool activity. Prevention wording alone is insufficient evidence.

Review implementation boundaries

Ask the partner for server-side checks and observed failures. OWASP documents prompt injection risks. Retrieval and model customization do not automatically remove this risk. The delivery scope should include a bounded failure response and an operator who can investigate unexpected behavior.

Related reading : AI feature rollout: compare a limited cohort with the existing workflow. Discuss your project scope with Sky Vaults.

Share this article