Velcro sounds the best idea so far, still thinking though......
What about a small pop rivet? Carpet over after you have put it in the hole, might be a little bit of messing about to get the carpet over the long thin bit. But three down the middle. The middle bit between the sound deadening/thermal lining will take three , top middle & bottom????
Just a thought