I would start by checking the power.
Indicator lights and oven lights often work on 120 volts while your elements need 240 volts.

Try turning the breaker off/on a couple times.
Sometimes you can loose half the line without actually tripping the breaker.
Better yet check it with a meter.

If OK, unplug the unit and check that a wire has not burned up somewhere, often this is at the terminal block in the unit.

Should I be concerned about the electricial box?

I would not be too concerned unless it starts happening on a regular basis.
Many others have had this problem so it is a fairly common occurance.

My pleasure, glad it worked out.