How can I check if someone is using my USB stick?

I want to know if someone is secretly accessing my USB drive. Is there a way to check if or when someone has accessed this drive or a specific file(s)?

Attention! This isn't about my computer, but specifically about a USB stick that I want to leave lying around the office to check whether I can trust my colleagues.

It is important that the note stating whether and when access has taken place cannot be removed by the informant (or can only be removed with as much difficulty as possible).