You can also get gems as gifts when playing in board mode as well, particularly in boards like the mischievous castle that have a lot of bonus gift squares.
I will say I wish there were both more things to unlock with gems and indeed more ways of getting them in single player, since once you've unlocked all the boards, hard mode and six party battle, the other unlocks cost several hundred gems each.
It'd be nice if prices for things were spread around a bit more evenly, also it'd be nice if you got more than one measily gem for each 100 points completing a zone, actually with the amount gems you need for certain unlocks, and the fact that some things you can buy with gems such as a pass to the unlock games world are rather expensive, imho it should be one gem per 40 points in single player, but hay, at least it gives something to work for, even if it'll take a lot of work, especially if your a more casual player.
Then again, I confess I've fallen off myself in the battle mode recently as I need to redesign some decs, so haven't played online battles for quite a while, and believe online battling can earn you more gems than minigames.
With our dreaming and singing, Ceaseless and sorrowless we! The glory about us clinging Of the glorious futures we see,
Our souls with high music ringing; O men! It must ever be
That we dwell in our dreaming and singing, A little apart from ye. (Arthur O'Shaughnessy 1873.)