You can get blind rivets that blank off the hole. They were used to hold VIN plates on, so the police could tell at a glance if it had been removed and refitted.
Some body shop suppliers may get them, as they may be used in other applications.
HTH JON