The trouble with trying to glue vinyl to plastic is just what you have experienced. No matter how well you clean the plastic the vinyl will not adhere properly. The chemicals use in the manufacturing of the materials are constantly off-gassing and they react with each other.

The create a better bonding surface, the plastic should be cleaned with lacquer thinner. It will evaporate fast and leave no residue. Then use the Weldwood adhesive to bond a thin underliner to the surface of the plastic. The felt will hold to the plastic. Not you can glue the cover vinyl to the felt without it lifting.