Usually the case comes with a pack of screws where the larger ones like the one on your GPU will fit in the hole.
Really depends on the case, some of them come with preinstalled screw covers, some of the less expensive ones like yours are just a removable sheet.
If you didn't want to borrow an external case one you can steal the top one from your GPU, I'd just make sure the lower one is snug.