PDA

View Full Version : Xenu Link Sleuth


Capn
05-05-2005, 01:42 PM
I'm running Link Sleuth (http://home.snafu.de/tilman/xenulink.html) on my bookstores as we speak - it's been going for over an hour now. As a result, I've added several thousand pages and starting to wonder if it will ever stop. :eek:

Greg
05-05-2005, 01:51 PM
I'm running Link Sleuth (http://home.snafu.de/tilman/xenulink.html) on my bookstores as we speak - it's been going for over an hour now. As a result, I've added several thousand pages and starting to wonder if it will ever stop. :eek:

If my coding is holding water, it will find every book in the amazon index through similars. That could take a while! :eek:

Capn
05-05-2005, 01:54 PM
If my coding is holding water, it will find every book in the amazon index through similars. That could take a while! :eek:

If you're correct, everyone with a FREEBS bookshop will eventually have every book in Amazon also. Could this be a problem?

Capn
05-05-2005, 02:04 PM
Just a thought, but I could remove the "Similars" template once I've reached my goal as far as number of pages. Would that work? If so, what is the best way to do it.

Greg
05-05-2005, 02:31 PM
Just a thought, but I could remove the "Similars" template once I've reached my goal as far as number of pages. Would that work? If so, what is the best way to do it.

Maybe the thing to do is add some conditional code around the similars that makes it able to stop displaying and adding books not on file.

I guess it could happen, and I've wondered. But remember, it's dynamic. If you follow the amazon rules and update your cached property info, the database will be growing and shrinking all the time.

However, you will never lose any indexed pages.

The maintenace will also make sure that your seed books are on topic. The DB gets way off topic if you just dilberatly surf the similars to add them to the DB.

So maybe we won't change anything after all.

Capn
05-05-2005, 04:19 PM
If you follow the amazon rules and update your cached property info, the database will be growing and shrinking all the time.

What is "cached property info" and how do I go about keeping it updated? :confused:

Greg
05-05-2005, 06:16 PM
1) What is "cached property info" and

2)how do I go about keeping it updated? :confused:

1) The info in the database about any book we have that displays on the index pages.

2) According to the Amazon TOS we have to update data on purchase pages daily. That part is done automatically. DB data has to be updated every three months, at the outside, for the rest.

The entries in the DB are dated and p3.php deletes expired books or updates them accordinly when run.

jhughes
05-23-2005, 07:50 AM
noppid, Thank you very much for the script.
Is it necessary to run Xenu on the book store to load everything into cache to make
the site faster. I did not notice a cache anywhere.

Greg
05-23-2005, 08:26 AM
It's a database. It caches the amazon products.

jhughes
05-24-2005, 06:56 AM
Thanks noppid, somewhere I forgot to ask what I really wanted to know.
Question:
Should I run Xenu through the site : Will it help the site get faster.
I was under the impression that when you run the install then it
already grabs all the Amazon information and puts it locally.

Greg
05-24-2005, 07:37 AM
No, install the book store and populate it with your keyword. There is no need to do anything else.

jhughes
05-24-2005, 10:50 AM
Thank you very much. The script works great.

Greg
05-24-2005, 01:58 PM
Thank you very much. The script works great.


Thanks, we wish you well with it.