SRL Archive - News and General

I though I read somewhere SRL wasn't supposed to be on google?

Well I was talking to Ron from SRL (He is uber smart) about my server being on Google (people could google for my caver and leech it there :O) and he linked me here http://www.robotstxt.org/robotstxt.html
Why doesn't SRL do this? You can Google for SRL and get results from it.
:)

If you add the robots.txt, results from Google go away the next time Google indexes the site.

Or is it because of the Google ads here? :/

I thought I heard that it did? Anyways, if it doesn't, I think it should be added.

From: bullzeye95
I thought I heard that it did? Anyways, if it doesn't, I think it should be added.

Explain please …

http://www.srl-forums.com/robots.txt 404 error :) They don't have it AFAIK ;)

I meant that I thought SRL used it, and that if it doesn't, then it should be added ;)

EDIT: Does robots.txt have to be at www.srl-forums.com/robots.txt, or can it be located elsewhere on the site?

http://www.srl-forums.com/forum/robots.txt
They do have it, but they only disable a few pages.

@bullzeye: :duh: Thought you said it shouldn't be added. :duh:

From: Markus
http://www.srl-forums.com/forum/robots.txt
They do have it, but they only disable a few pages.

why don't they add it to al pages?
because leeching is a bad thing:(

I still don't understand why do people think that SRL shouldn't be found on Google or Yahoo etc, people know about us, well maybe not the people that think Macro = EvilHackphr0mGoogleAutoFighter.exe, but for example when SMART was released to public - what happened to the Message of the Week?

"Do not download programs that help you play RuneScape - they might steal your password!".


Harry, I think it's stupid to keep your scripts on your server, why not to attach them straight on like regular people, it's some trouble to run a script that downloads a script to your files somewhere, and then you have to open it again. If I want to see your script, I just leech the URL from the updater script and copy paste it.

If you would attach it, you also wouldn't have to be afraid of leeching…

Haha - someone has even pastebinned it -
http://www.google.fi/search?q=Hy71194+Fight+caves+runner&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:fi:official&client=firefox-a

Haha - someone has even pastebinned it -
http://www.google.fi/search?q=Hy7119...nt=firefo x-a

Harry, your script is getting leeched i think.

I think there is another posibility to leech, new users try to download this:
http://www.srl-forums.com/forum/attachment.php?attachmentid=11120&d=1205861097

I'm 100% sure it won't let them as it runs the same check as if they just clicked on it. I'm sure vBulletin has it built in the attatchments php file.
Anyway, keeping SRL off google won't do anything. I'm pretty sure even now it's very hard to find a common way of putting runescape hack into google and getting SRL anywhere near the front, so there's not much point in using a Robots.txt to make them avoid half the forum. Anyway, I'm pretty sure the bots only get access to the un-registered users stuff, so not much to loose from there.

From: Cazax
Harry, your script is getting leeched i think.

I think there is another posibility to leech, new users try to download this:
http://www.srl-forums.com/forum/attachment.php?attachmentid=11120&d=1205861097

I was able to download that script, should I be able to?

From: Mistran
I was able to download that script, should I be able to?

yes you should i think.

People cant leech using google since the pages for the downloads you need an auth which google-crawler doesnt has. robots.txt is used when you want to block a crawler/bot/indexer to stop indexing your whole site. But it also means that if you google this site you wont find it.

This forum does not use robots.txt… you can simply tell by trying to visit http://www.srl-forums.com/robots.txt…. you get page not found, because it doesn't exist!

I see no problem with this site being listed in google. At the end of the day you need new members and new blood to keep this community going.. becoming too elitist will just kill it..

Encourage Loyalty, encourage n00bs, encourage inovation, we all have to start somehwere!

Personally I don't feel this community is at all welcoming and I have no loyalty to it! I'm a member and that's as far as it goes!

As already stated, it does http://www.srl-forums.com/forum/robots.txt

robots.txt should be in the root of the domain. anywhere else and under the specifications it ain't binding it's still just proposed…

>_< THE REAL ISSUE HERE IS THAT HY IS GROUNDED FOR A MONTH >_<

umm.. anyways :D

it doesn't really matter if SRL is on google because Jagex knows about SRL… they just can't do anything about it really ^^ just don't put your username/password/skills in anything :o!

robots.txt file only will be function unless they have been declare on every each page with the html code implement like

<meta name="robots" content="noindex,nofollow">

From: HellBoyz
robots.txt file only will be function unless they have been declare on every each page with the html code implement like

Wrong.. That meta is if you want to do it on a page by page basis and was implimented for users that don't have enogh server access to add a robots.txt file. The robots.txt File allows you to instruct a bot on a site-wide basis to exclude/include an entire site, entire paths or extention of a particular type etc etc.