Search Engine Optimization
 
Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
 
 
User Name:
Password:
Remember me
Go Back   SEO Chat ForumsSearch Engine StrategiesSearch Engine Optimization

Reply
Add This Thread To:
  Del.icio.us   Digg   Google   Spurl   Blink   Furl   Simpy   Y! MyWeb 
Thread Tools Search this Thread Rate Thread Display Modes
 
Unread SEO Chat Forums Sponsor:
  #1  
Old December 6th, 2004, 11:31 AM
marcyboy marcyboy is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Aug 2004
Location: UK
Posts: 222 marcyboy User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 2 Days 18 h 3 m 27 sec
Reputation Power: 5
Talking Site Map Tool?

Hi All,

Dont know if Im posting in the right place, so appologise before hand. ANyone know of any tool which
scans an entire site, and builds a sitemap.

We do have a sitemap which contains 200 pages which are the most important, but upon closer analysis noticed that we actually have over 4000 pages, most of which remain unindexed, because they are difficult for the SE's to get to.

So, I would like to make my life a bit easier if possible, by using a tool which could scan it and at least give me the links on a sitemap.

Thanks

Marcel
<snip>

Last edited by Jasontnyc : December 6th, 2004 at 02:24 PM. Reason: sig after 90 days and 100 posts

Reply With Quote
  #2  
Old December 6th, 2004, 11:59 AM
dazzlindonna's Avatar
dazzlindonna dazzlindonna is offline
Contributing User
SEO Chat Expert (3500 - 3999 posts)
 
Join Date: Mar 2003
Location: Louisiana, USA
Posts: 3,876 dazzlindonna User rank is Corporal (100 - 500 Reputation Level)dazzlindonna User rank is Corporal (100 - 500 Reputation Level)dazzlindonna User rank is Corporal (100 - 500 Reputation Level)dazzlindonna User rank is Corporal (100 - 500 Reputation Level) 
Time spent in forums: 1 Week 6 Days 4 h 22 m 36 sec
Reputation Power: 13
might want to try xenu (http://home.snafu.de/tilman/xenulink.html). it is primarily for checking for broken links, but it also includes a site map feature. and its free.
__________________
Military Singles Dating

Reply With Quote
  #3  
Old December 14th, 2004, 06:15 PM
jeof0411 jeof0411 is offline
Registered User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Jun 2004
Location: Georgia
Posts: 8 jeof0411 User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 1 h 10 m 14 sec
Reputation Power: 0
a Php Sitemap Script

I use a basic php script that I found online. takes a little bit of configuration to exclude directories you don't want indexed and it only lists pages by their filename but it's dynamic so you never need to update it.

I am not sure if this is going to print out right but we will see:

Code:
<?php
$showsize = 0; /* Show size of each file, 1 for yes, 0 for no. */

/* Array with file types to display and the pictures to use.
Syntax: $display['filetype'] = "picture"; */

/*$display['php'] = "php.gif";*/
$display['html'] = "html.gif";
$display['htm'] = "html.gif";
$display['shtml'] = "html.gif";

/* Array with directories to exclude. List as many directories as you want here 
Syntax: $excludedir[] = "directory"; */

$excludedir[] = "temp";
$excludedir[] = "cgi-bin";


/* Array with files to exclude. Same syntax as above */

$excludefile[] = "file1.html";
$excludefile[] = "file2.html";

?>

<html lang="en">
<head>
<title>Sitemap</title>
<meta name="description" content="Site map of your website.">
<meta name="robots" content="index,follow">
</head>
<body bgcolor="#000000" text="white" link="#2255FF" visited="magenta">
<b><a href="http://www.yoursite.com">Sitemap for My Website</a></b><br>
<p>
<?php
$stime = gettimeofday();
/* some preliminaries... */
$root = getcwd();
$pre = explode("/", $_SERVER['REQUEST_URI']);
array_pop($pre);
$prefix = join("/", $pre);

/* Uncomment the 2 lines below to create a tree of all files and directories on your webserver if the script
 * is in a subdirectory */
//$root = str_replace($prefix, "", $root);
//$prefix = "";
$root .= "/";

/* Display server name and directory */

echo "<table cellspacing=0 cellpadding=0 border=0>\n";
echo "<tr><td><img align=absmiddle src=server.gif> http://".$_SERVER['SERVER_NAME'];
echo "$prefix/";
echo "</td></tr><tr><td><img align=absmiddle src=vertical.gif></td></tr>\n";
function get_extension($name) {
	$array = explode(".", $name);
	$retval = strtolower(array_pop($array));
	return $retval;
}
/* Recursion, here we go.. */

function list_dir($chdir) {
	/* some globals, some cleaning */
	global $root, $prefix, $showsize, $display, $excludedir, $excludefile;
	unset($sdirs);
	unset($sfiles);
	chdir($chdir);
	$self = basename($_SERVER['PHP_SELF']);
	/* open current directory */
	$handle = opendir('.');
	/* read directory. If the item is a directory, place it in $sdirs, if it's a filetype we want
	 * and not this file, put it in $sfiles */
	while ($file = readdir($handle))
	{
		if(is_dir($file) && $file != "." && $file != ".." && !in_array($file, $excludedir))
		{ $sdirs[] = $file; }
		elseif(is_file($file) && $file != "$self" && array_key_exists(get_extension($file), $display)
			&& !in_array($file, $excludefile))
		{ $sfiles[] = $file; }
	}
		  
	/* count the slashes to determine how deep we're in the directory tree and how many
	 * nice bars we need to add */
	$dir = getcwd();
	$dir1 = str_replace($root, "", $dir."/");
	$count = substr_count($dir1, "/") + substr_count($dir1, "\\");
		  	  
	/* display directory names and recursively list all of them */
	if(is_array($sdirs)) {
		sort($sdirs);
		reset($sdirs);
			 
		for($y=0; $y<sizeof($sdirs); $y++) {
			echo "<tr><td>";
			for($z=1; $z<=$count; $z++)
		  	{ echo "<img align=absmiddle src=vertical.gif>&nbsp;&nbsp;&nbsp;"; }
			if(is_array($sfiles))
			{ echo "<img align=absmiddle src=verhor.gif>"; }
			else
			{ echo "<img align=absmiddle src=verhor1.gif>"; }
			echo "<img align=absmiddle src=folder.gif> <a
				href=\"http://".$_SERVER['SERVER_NAME']."$prefix/$dir1$sdirs[$y]\">$sdirs[$y]</a>";
			list_dir($dir."/".$sdirs[$y]);
		}
	}
		 		  
	chdir($chdir);
		  
	/* iterate through the array of files and display them */
	if(is_array($sfiles)) {
		sort($sfiles);
		reset($sfiles);
				 
		$sizeof = sizeof($sfiles);
			 
		/* what file types shall be displayed? */
		for($y=0; $y<$sizeof; $y++) {
			echo "<tr><td>";
			for($z=1; $z<=$count; $z++)
			{ echo "<img align=absmiddle src=vertical.gif>&nbsp;&nbsp;&nbsp;"; }
			if($y == ($sizeof -1))
			{ echo "<img align=absmiddle src=verhor1.gif>"; }
			else
			{ echo "<img align=absmiddle src=verhor.gif>"; }
			echo "<img align=absmiddle src=\"";
			echo $display[get_extension($sfiles[$y])];
			echo "\"> ";
			echo "<a href=\"http://".$_SERVER['SERVER_NAME']."$prefix/$dir1$sfiles[$y]\">$sfiles[$y]</a>";
			if($showsize) {
				$fsize = @filesize($sfiles[$y])/1024;
				printf(" (%.2f kB)", $fsize);
			}
			echo "</td></tr>";
			echo "<tr><td>";
			
		}
		echo "<tr><td>";
		for($z=1; $z<=$count; $z++)
		{ echo "<img align=absmiddle src=vertical.gif>&nbsp;&nbsp;&nbsp;"; }
		echo "</td></tr>\n"; 
	}
}
list_dir($root);
echo "</table>\n";
/* How long did that need..? */
$ftime = gettimeofday();
$time = round(($ftime[sec] + $ftime[usec] / 1000000) - ($stime[sec] + $stime[usec] / 1000000), 5);
echo "<center>This page was generated in $time seconds.</center>\n";
?>
</body>
</html>

Reply With Quote
  #4  
Old December 14th, 2004, 11:17 PM
rxcllc rxcllc is offline
Contributing User
SEO Chat Newbie (0 - 499 posts)
 
Join Date: Sep 2004
Posts: 155 rxcllc User rank is Just a Lowly Private (1 - 20 Reputation Level) 
Time spent in forums: 9 h 14 m 19 sec
Reputation Power: 5
that's a pretty cool script. it would work really great on huge sites. thanks for the post!
__________________
Creative online marketing or advertise with text links.

Reply With Quote
Reply

Viewing: SEO Chat ForumsSearch Engine StrategiesSearch Engine Optimization > Site Map Tool?


Thread Tools  Search this Thread 
Search this Thread:

Advanced Search
Display Modes  Rate This Thread 
Rate This Thread:


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
View Your Warnings | New Posts | Latest News | Latest Threads | Shoutbox
Forum Jump



 Free IT White Papers!
 
How to Present Effectively Online
This white paper offers practical and actionable advice on the key steps that any presenter should consider as they plan and execute a Webinar or online meeting.

Request Your Free Technology Downloads!
 
Open Source Security Myths
Open Source Software (OSS) is computer software whose source code is available to the general public with relaxed or non-existent intellectual property restrictions (or arrangement such as the public domain), and is usually developed with the input of many contributors.

Request Your Free Technology Downloads!
 
Power and Cooling Capacity Management for Data Centers
This paper describes the principles for achieving power and cooling capacity management.

Request Your Free Technology Downloads!
 
Scalable, Fault-Tolerant NAS for Oracle - The Next Generation
For several years NAS has been evolving as a storage alternative for Oracle databases, and for good reason: NAS is quite often the simplest, most cost-effective storage approach for Oracle. Learn about the benefits that HP's approach to scalable NAS brings to Oracle environments in this comprehensive white paper.

Request Your Free Technology Downloads!
 
Understanding Web Application Security Challenges
This white paper discusses many common threats and preventive measures for Web application security, and explains what you can do to help protect your organization.

Request Your Free Technology Downloads!
 

Forums: » Register « |  User CP |  Games |  Calendar |  Members |  FAQs |  Sitemap |  Support | 
  
 





© 2003-2009 by Developer Shed. All rights reserved. DS Cluster 4 hosted by Hostway
Stay green...Green IT