Yes, keep the thermostat dry. And use a non-water thing rather than ice.
I doubt that Ice would help a loot. It probably has a plate that is connected to the radiator directly to read the heat output... to manipulate that you would have to find a way to remove it 1st... then insert a insulated plate on the contact and re attach it.