SRL Archive - General

So I want to mine data from web pages using google search method, but Im going to go 2 levels deep , dream within a dream kinda concept ( basically google search –> website – > another website ( extraction point) .

I was planning to build it using a PHP based system so i can host it on servers and directly use the data for my website.

Now i need your help to figure out the best way to do this kind of thing and I know there are alot of things out there like cURL and ruby.


Plz no :google: suggestions i already tried and gave up.

Thank you :)

http://stackoverflow.com/questions/3577641/how-to-parse-and-process-html-xml-with-php/3577662

Ganon is mine :)

wow thats reallly cool, jsut a quick question tho do u know anyways to solve captchas other than doing it manually

You need to solve it one way or another. You have services which solve them for you or you can create your own solver.

I'm unsure as what you mean.

Are you trying to take information from a website and place them into simba?

no my plan was to take information and put them into a database such as mysql

From: SubiN
no my plan was to take information and put them into a database such as mysql

http://villavu.com/forum/showthread.php?t=94643

This technique might help,

If writing in PHP you will need to do the following In no order:

Hookup the database.

http://php.net/manual/en/reserved.variables.get.php

Basically, you make it so the url which will be var=''&var='' etc has the information and from that point it adds the info to a database.

You can hide that url to stop other people getting into it.

But if your already logged into the admin panel (Make your own login), you can use this:

http://www.daniweb.com/web-development/php/tutorials/384358/password-protecting-a-site


Hope I've got what you wanted ^^