Here are your parts
Replacement parts for FRS26ZXH models | AppliancePartsPros.com
Sounds like the control (thermostat) (Item 21 in Section 5) is sticking open.
Next time it starts to warm up turn the control or give it a tap, if it starts up then odds are it is the thermostat.