MIKE GEORGE says: Firstly, don’t over-tighten the screw, or you could pull the threaded insert out of the wood, or even strip the thread. Then you would be in even worse trouble!
Best way of securing the screw is to remove it, clean off any oil, and put it back in with a smear of Loctite thread-locker on the threads.
The grade to use is Loctite 242. Stronger grades (and there are quite a lot) may lock the screw in so tightly that you would never be able to take it out again. Grade 242 should hold it in place, but also allow disassembly with ordinary hand tools.