Well, I've had this problem before, and it's actually gone away. Lots of people read my Fic, regulars or new readers. So I can say firsthand how it is.
It is indeed frustrating(obviously). I work hard at writing, and it's quite discouraging when people turn a blind eye to my Fic(s). Personally, I find that advertising helps. My entire Signature is dedicated to promoting my Fic. And I think that's helped a bit, really. People get intrigued by what you put in your Sig, believe it or not. Not everyone will, but a few curious readers might decide to check it out.
My Fic is far from the most popular Fic here. It has a lot of Replies, though, a lot more than many other Fics. I persist in writing, and hope that I get the reviews and replies I desire. In the end, though, I write because I enjoy it. Writing is my passion, other people liking it is just a perk. Authors should write because they like it, not because they want attention. It actually helps to distract you from the lack of attention at times if you're just having fun with what you're doing.
So, yeah. I really just keep on writing, whether I have one reader of one hundred. Sooner or later, people will begin to recognize you. My first Fic failed miserably, and it would've been the ideal time for me to quit. But I kept on trying, and
Hoenn's Legacy has ended up a pretty well-liked Fic. Keep writing, all you who lack in reviews. People will get interested sooner or later, usually later. Don't be discouraged if your Fic isn't immediately the next Harry Potter. It all takes time.
~*CB*~
The 8th Champion