On your computer the system files is ntfs
on your Key it's fat32
on fat32 their is no control on the security (can't ad user or group in security)
When you copy file or directory in the key, the folder lost the control of shared and security
I think it's that.