Here are your parts
Replacement parts for Art6610WW models | AppliancePartsPros.com

I'm sure I just need to replace the oven element. Is that correct?
Cannot say for sure.
Best way is to unplug/remove power from the unit, remove the element and check it with a meter.
If open (infinite ohms) it is shot.

It is a good idea to clip something (clothespin etc) to the wires before removing them from the element so they do not disappear into the back of the oven.

If you do not own a meter, I would suggest you purchase a one. You can get a decent digital multimeter for under $20.00. You do not need fancy though it is nice if the leads are a couple feet long.
If it saves ordering one unnecessary part it has paid for itself and you end up owning a useful tool.
Most places will not let you return electrical parts so if you order it, you own it.
A couple things to watch when measuring ohms and continuity
1. Always remove power from the machine otherwise you could blow your meter.
2. Always disconnect at least one side of any device you are checking. This eliminates the possibility of measuring an alternate/parallel circuit path.
3. When checking for closed contacts and continuity use the lowest scale (Usually 200 ohms). Then try higher scales. This scale is 0 to 200 ohms so if the device you are measuring is 300 ohms this scale would show an open circuit which it is not, you are just measuring outside the scale's dynamic range.

There is a good STICKY at the start of this forum about it's use.