Maybe your missing some link bait. ?
You don't say what your site is about but if you can come up with a reason for people to link to you then the 5,000 links could happen a lot quicker and more natural than if you posted them.
If your manually posting / finding these high quality backlinks and spending say 1 hour each then your looking at 5,000 hours, I am sure you could spend a fraction of that time to come up with reasons for people to want to link to you.
Good SERPS is great, Traffic however is even better