Google spidered my test site!

Google spidered my test site!

Google spidered my test site despite using a robots.txt disallowing it!

I now have the problem of some links appearing on the test. subdomain, and some on the new site.
Currently, the test. subdomain is dead, so the links go to a "This page cannot be found" page. Don't want to set up a redirect to the new site, or Google will continue to index the test. subdomain.

I'm assuming, the best course of action, is just to wait until Google pulls the old test. pages out of it's database when it realises they are dead links. Then it should start to index the real ones.

How would you do it? Thanks

You can remove the pages through webmaster tools.

Are you 100% certain you have the robots file set up correctly and with no mistakes? Double check it in webmaster tools.

Make sure on your 'this page is not available' page you are passing the right headers. Not required but a good idea in case you end up using the page again.

if your positive that your robots.txt file is set up properly you can always add a meta robots code to each test page for extra "insurance".