Hi,
It sounds like you two are being bullied of sorts, and this is just unfair.
Sometimes with a show, it's not just about the main show. It's sometimes about the community that springs around it, creating fanfiction, some of it darker than the original material, that makes it appeal to people. People are sometimes more interested in a show's world and it's lore.
Here's an example of how worldbuilding can help, using the new My Little Pony, as that's the thing I've been looking at lately, and again I'm quite surprised at how much of a world there is, so bare with me a little while I try to explain, but I might fail and it might just look very silly:
Equestria seems to be a country or even a continent of sorts, it started out being managed by three princesses but now has four, from the capital of Kanterlot. They all seem to, originally, be Unicorns. If someone achieves something that is considered extraordinary then their reward is to become an Alicorn princess, so they gain wings and, maybe even more powerful magic, thus the fourth princess eventually, but this took a while and the character in question was shocked when it happened, in fact it wasn't even her goal to become a princess.
Sometimes, the princesses just have to do things to make visitors know that they are welcome and such, and for one inparticular this was very boring and frustrating, but of course they have to keep things in check too (more on that later).
Equestria has several cities now. There's the mainstay, Ponyvill, which is where most of the series takes place. This small town has almost always been a part of My Little Pony.
However, there are now several other places.
There's the aforementioned Kanterlot, which is the capital, lots of stuff going on from markets to big events.
There is also Cloudsdale, a city quite literally in the clouds ran by the Pegasus race. They control the weather, so unlike here on Earth, the Pegasus themselves are the ones who cause most of Equestria's storms and rain, to allow the land to have water and such. Unicorns can learn a cloud walking spell if they or their friends wish to visit.
There is the crystal empire, which was once taken over by a villain but it got restored, I don't know much about what it's used for as I have to do some past season catchup.
Lastly, there is the Everfree forest, a place that almost everyone fears, but the more adventurous type will try going in there. Everything is a bit like Earth, plants grow themselves, the weather is forever changing by itself, and there are loads of creatures, some of them very wild and dangerous. Even Hydras are known to live in there, along with dragons and who knows what else.
Equestria isn't without it's dark places. If someone has done something exceptionally evil then they get sent to Tartarus, I'm not entirely sure where it's located though. It's a prison of sorts, but not unbreakable -- a villain once escaped. Thus, the newest princess had to stop him and that's how she discovered her destiny so to speak, and it was a large challenge for her, it was very dangerous.
There are a few characters that people like to create fanfiction about. One of them is Discord, a mishmash of different parts of creatures who can talk and who can bend reality and such, he's rather weird. The other one is Equestria's version of the changeling race, who have only ever appeared in two episodes but have lots of fanfiction written about them, (side note: I should try reading some of that to see what everyone's talking about.)
there's Star Swirl the bearded, someone who hasn't even appeared in the series, but who has been mentioned by Princess Celestia as living a long time ago. Well, people have put that character in their fanfiction.
Lastly and perhaps most intriguing, the fans have created fanfiction for the background characters of the show, and even the creators have said, let the fans create their own adventures for these characters. They didn't even have official names, and now, they are using the fan names on merchandise, but these characters haven't appeared in the show itself yet.
Also, I don't know why but this Pony series is really causing people to get creative, to check their spelling and grammar on things they write and to make sure things will be the best they can be. Why does it have to be Ponies that cause this? I honestly can't answer that question, and I don't know if I ever will be able to, but it seems to be happening that way.
So, in conclusion, instead of a small little town called Ponyvill and that being the end of that, Equestria has now become a place that has people talking about it's world and lore, as detailed as the autobots and decepticons battling it out for a planet called Cybertron, with it's own relics and artifacts and history.