Block Affiliate URL

Hi All,

i have around 1000+ pages indexed in google for my site. Some affiliate campaign also going on for my site. Few of affiliate URL indexed in google from this affiliate campaign.

I already implement this code in my robots.txt
-----------------------------------
Disallow: /?agent_add=
-------------------------
but still this affiliate URL crawled.
Can anyone suggest how to stop crawler to crawl this type of URL.
some example URL given here.

http://www.sitename.com/?utm_source=Splut.com&utm_medium=cpc http://www.sitename.com/index.html?agent_add=15975345&agent_bann=12458475 http://www.sitename.com/index.html?agent_add=15975345&agent_bann=12495751 http://www.sitename.com/index.html?agent_add=15975345&agent_bann=20423001 http://www.sitename.com/index.html?agent_add=16643001&agent_bann=213%2086001 http://www.sitename.com/index.html?agent_add=16643001&agent_bann=213%2087001 http://www.sitename.com/index.html?agent_add=16643001&agent_bann=213%2088001 http://www.sitename.com/index.html?agent_add=21562001&agent_bann=21584001 http://www.sitename.com/index.html?agent_add=21880001&agent_bann=21881001

I don't see "/?agent_camp=" in any of those urls!

If they're actual examples why not try:
-------------------------
Disallow: *agent_add*
-------------------------

Hey ClickyB

Thanks for you great suggestion.

Now i want to say there is problem of affiliate urls in my site also.

in my site Google indexing this type of Affiliate urls so how i can block that pages? please suggest me..

/product.html?a_aid=6bee5108&a_bid=d08e3667
/product.html?a_aid=80c69612&a_bid=95308704%20
/product.html?a_aid=6bee5108&a_bid=95308704

These types of urls increasing more and more day by day.

I am waiting for your reply, Thanks

The only way you can block a selection of urls using a single robots.txt line (in other words without making a new line for every url you create) is if those urls all have something in common with each other and also "unique" to the group!
So - if "a_aid" only appears in your affiliate urls (and appears in ALL your affiliate urls) you could use:
-----------------
Disallow: *a_aid*
-----------------
to exclude them.

If other urls also use that and there's no "unique" identifier for your affiliate urls, you can't exclude it by using robots.txt
You could use a "noindex" or "nofollow" robots metatag for them (assuming you can edit the tag on a page-by-page basis).

You could also make sure that all links to it use the "NOFOLLOW" attribute.

Google Webmaster Tools offers the option to de-index URLs that you don't want indexed.

If there are no links pointing to them and you tell Google you don't want them in its index they will not be in there for long!

You don't have an automated sitemap generator that is adding them to an XML sitemap do you?

noindex,nofollow works. If you were using server side includes for all of the info in the head tag, you could add this directive once, and it would apply to many pages.

With reference from those URLs, is it possible to block only
/product.html?a_aid=80c69612&a_bid=95308704%20
/product.html?a_aid=6bee5108&a_bid=95308704

using these conditions?
"exclude all URLs with a_aid and a_bid=95308704"

Thanks,
Morph