Posted on August 8, 2008 by spyderwebtech
In my last post, Scraping Web Pages with cURL, I talked about what the cURL library can bring to the table and how we can use this library to create our own web spider class in PHP.
What I want to do in this tutorial is to show you how to use the cURL library to [...]
Filed under: Automation, General Discussion, PHP Tutorials, SEO Tools, Web Page Scraping, Web Spiders, cURL Tutorials | Tagged: build web spider, CURL, cURL library, curl tutorial, curl web page scraping, data mining, object oriented programming, PHP, PHP classes, php object, php web spider, php web spider tutorial, Web Page Scraping, web site download | 6 Comments »
Posted on December 5, 2007 by spyderwebtech
In my last post, Building A Web Spider – Part 1, I covered how to analyze a website so that you can build a very simple web spider to collect the data that you want, and then I showed you how to use PHP to download that page to your server. In [...]
Filed under: Automation, General Discussion, SEO Tools, Web Page Scraping | Tagged: HTML, PHP, preg match, regular expressions, web crawler, web page download, web site scraping, web spider | 24 Comments »
Posted on December 1, 2007 by spyderwebtech
Whether you want to gather data for a database web site, or determine which links are broken in your site a web spider is a great tool for getting repetitive tasks done. Scraping web pages from the internet is a great way to gather content and ideas for web sites that you want to [...]
Filed under: General Discussion | Tagged: build web spider, database sites, PHP, scraping web pages, SEO SMARTY, web spider | 13 Comments »
Posted on November 27, 2007 by spyderwebtech
In my previous posts, I talk a lot about web site scraping to gather data from the web to create a database web site. The question in you may have in your mind is exactly how does one do this. The good news is that there are many ways to get this done, [...]
Filed under: Automation, General Discussion, SEO Tools, Web Page Scraping | Tagged: CURL, Godaddy, HTTP, Imacros, PHP, RUBY, scraping, web hosting, web page, Web Page Scraping | 4 Comments »
Posted on November 26, 2007 by spyderwebtech
Holly smokes! What a productive week it has been for me on my SEO empire building journey!
This week I continued on with my experiment to use WordPress MU as a template engine. What I wanted to do is simply download a bunch of WordPress plugins to customize my sites for things such as [...]
Filed under: Activity Log, Progress Reports | Tagged: blog, CURL, database sites, Google, PHP, script, Search engine spiders, Seo Empire, wordpress, Wordpress MU | 3 Comments »
Posted on November 24, 2007 by spyderwebtech
Now that we have our databases and have laid out the best structure to produce 1000s of web pages for our site, its time to start building! But how in the world are you going to find time to create 1000s of unique content for your site. Well this is where we are [...]
Filed under: Automation, Building Database Sites, General Discussion, SEO Concepts | Tagged: Seo Empire, SMARTY SEO, blue hat seo, database web sites, PHP, MSQL, content generation, links | Leave a Comment »
