Sallah Ud Din Sarwar

We needed to get the description of a site automatically from its url after parsing the HTML markup, for one of the Drupal sites we were working on. This is a task that can be easily accomplished by using the PHP curl library. Read on to know how to use a php script and curl…

There are so far 6 ways of Getting webpage content (full HTML) in PHP are most commonly used. The methods are using file() fuction using file_get_contents() function using fopen()->fread()->fclose() functions using curl using fsockopen() socket mode using Third party library (Such as “snoopy”) 1. file() <?php $url=’http://blog.oscarliang.net’; // using file() function to get content $lines_array=file($url); // turn…

The word “crawling” has become synonymous with any way of getting data from the web programmatically. But true crawling is actually a very specific method of finding URLs, and the term has become somewhat confusing. Before we go into too much detail, let me just say that this post assumes that thereason you want to…