SRL Archive - Help

Downloading a website?


Runescapian321

2009-06-26 06:47:56

I've tried a couple free programs I got off of download.com, but none of them can do what I want them to do - log on to a site that requires a username and password and proceed to download everything inside for offline viewing. Reason I want this done is because I have access to this certain page for only a limited period of time, but all it is is text, images, and files pretty much. I'd like to download everything so I can view everything inside when I can no longer log in. Does anybody know of a website downloader that can log in (the log in is extremely similar to most forum logins, with some text above the Username/Password along with a Remember Me button under it all) to a site? Yes, I've tried using the Remember Me, but for some reason it won't start logged in when I run the downloader.

Thanks in advance :)

ian.

2009-06-26 06:51:02

Everything on the whole site? Like if you were to do it for this site you'd want every thread and every post, too?

Brain

2009-06-26 06:54:37

file>save page as….

that good enough? :p
It would take a long time though…

Buckleyindahouse

2009-06-26 06:54:54

IDM

Internet Download Manager has a website crawler, Check it out.

Harry

2009-06-26 07:49:45

TeleportPro is awesome. I use it for all siterips I make. It is very efficient, easy to configure, highly customizable for what content you want in specific, and it is wicked light.
log on to a site that requires a username and password and proceed to download everything inside for offline viewing. Reason I want this done is because I have access to this certain page for only a limited period of time, but all it is is text, images, and files pretty much.

Let me take a guess on the content though, is it porn? ;)

NiiX

2009-06-26 13:38:09

From: Buckleyindahouse
IDM

Internet Download Manager has a website crawler, Check it out.


You can also save the HTML and everything in it, also a good idea.

Runescapian321

2009-06-26 14:38:54

It's not, Harry :p It's a programming camp's database of lessons, explanations, etc. Ill try these when I get home, only have access to the site for like 16 more hours :s.

Runescapian321

2009-06-27 02:51:21

(Sorry for double post :\)


From: Buckleyindahouse
IDM

Internet Download Manager has a website crawler, Check it out.


From: Harry
TeleportPro is awesome. I use it for all siterips I make. It is very efficient, easy to configure, highly customizable for what content you want in specific, and it is wicked light.

Let me take a guess on the content though, is it porn? ;)


Neither of those worked, they just grabbed the login page and wherever you can go from there without a username/password, even though I put the username/password into the provided fields on the downloaders :(

Dan Cardin

2009-06-27 03:28:11

http://www.surfoffline.com/
http://www.httrack.com/ <- ive used before and it should work.

search offline browser for more.

WhoCares357

2009-06-27 03:50:28

You can use Firefox+DownThemAll! to download everything on a single page. I don't know if this is what you want. It's really only useful if you want to save a few pages. Would take a while to save a whole site.

caused

2009-06-28 04:00:01

Use Scar :D

ian.

2009-06-28 04:10:24

From: caused
Use Scar :D


Not a bad idea, actually.


for i := 1 to High(Threads) do
Writeln(GetPage('www.site.com/forum/showthread.php?t='+IntToStr(i)));

that'd work for villavu.

MylesMadness

2009-06-28 05:42:39

From: 99_
Not a bad idea, actually.


for i := 1 to High(Threads) do
Writeln(GetPage('www.site.com/forum/showthread.php?t='+IntToStr(i)));

that'd work for villavu.
It will take for ever due to all the stuff that's been deleted, not visible, ect

cman334

2009-07-01 05:10:32

file > save page as… or just view it and do not clear cache and you should be able to view it in offline mode.