i think your using alex, for some reason it does that to me sometimes

That happens with the default speech.

Add a second language to your rotor and use that instead until Apple fixes it.

But you can still add English to your rotor.

You should be able to fix it. Try this,
On your punctuation group, press add, then, in the punctuation field, go to numbers, and put in a quote, voiceover should say double open quotationark. On the rules, press ignore. Go back to the previous screen and press add again. This time, in the punctuation field, go once again to numbers and quotation mark, but put two quotationmarks next to each other, without any spaces. You should hear voiceover say, doubleopen quotationmark, for the first one, and, doubleclosing quotationmark for the second one. Now, switch your rotor to characters, and put the curser after  the doubleopening quotationark, and press delete. If you go by character, you should only see the doubleclosing quotationmark in the punctuation field. Once again, hit ignore in the rules, and go backt to the previous screen.
Your done. If your having the same problem with single quotationarks, do the same steps as above, but with apostrophe as the punctuation sign.