A backward installed thermostat will cause the same thing. You may even see the suction hose collapse, due to the water pump vacuum.
I would totally remove the thermostat (actually, what I did was pull the guts out and used the neutered core to make sure it seals on the o-ring OK). AND try another tank cap.