SRL Archive - News and General

There is often 14, or ever sometimes more, web spiders indexing SRL Forums constantly. Why does SRL not just set a robots.txt file in their main directory and block all webspiders except for the Adsence bot for the ads? :rolleyes: Each one of those spiders make SRL use more bandwidth, making SRL cost more per month.

Google Spider
Viewing Thread
What does 'tut' mean?

03:05 PM Google AdSense Spider
Viewing Thread
FrugooScape Autoclicker

02:53 PM Yahoo! Slurp Spider
Viewing User Profile

03:05 PM Google Spider
Viewing Index
SRL-Forums

03:05 PM Google Spider
Viewing Thread
Dodian Script Pack

03:05 PM Google Spider
Viewing Thread
VERY easy way to add smart

02:57 PM Google Spider
Viewing Index
SRL-Forums

03:04 PM Google Spider
Viewing Index
SRL-Forums

03:05 PM Google Spider
Viewing Index
SRL-Forums

02:56 PM Google AdSense Spider
Viewing Thread
How much GP have you made from autoing? (staking is allowed, too)

03:01 PM Google Spider
Viewing Index
SRL-Forums

03:04 PM Google AdSense Spider
Viewing Index
SRL-Forums

That's a list I got of them. Isn't that a great waste of SRL's bandwidth??

-Discuss :D

No waste…
No spiders, no indexing…

Why must we be indexed?

Indexing increases chance of someone coming to SRL from a search engine. Not only that, but they use less bandwidth of one user, which is near nothing as is, due to no downloading files and just pages, so they don't affect the site negatively at all.

Freddy, I thought I have heard the admins say that they don't want people finding SRL through search engines. Though this was more than a year ago, so their views may have changed (assuming I am right about them once opposing it).

I found a nice quote from 2 years ago ;)

From: Flyboy
SRL is about to hit the streets. I can already detect the sound of countless feet tromping this direction! Good times are ahead I would think!

Welcome aboard everyone. Buckle up and hang on, cause we are going for a ride of a lifetime!!!

That's for sure. But in a topic like that (can't find it anymore :() they want SRL to be kept private, excluded from Google. Although, I don't know what their statements are now :)

more people = more scripts, but more leechers and scammers.

I think ya'll have gotten a little off topic… Where did you find this Hy?

Well without the indexing, wouldn't we not be cached in google?

From: laurenssie0
I found a nice quote from 2 years ago ;)



That's for sure. But in a topic like that (can't find it anymore :() they want SRL to be kept private, excluded from Google. Although, I don't know what their statements are now :)

That is from when SRL was about to go public. We used to be a private community as you can tell. Then Fakawi's wifey got sick and he had to leave for awhile, thats when it went public. Before it was, there was no way to "Stumble on SRL" either you knew it or you didnt, or someone told you about it. Cause you had to use the actual IP address of the server to get here.

i dont notice any lag….now if the site were really inresponsive (to the point of taking average 20 sec. a page to load), that would be differant.

I do only notice lag when I'm postin a post (right now :p) It's worth a bit of lag that more people do come to SRL.