Change of plan
November 23rd, 2006 by GregI am afraid to say there has been a change of plan on idea of selling the script behind Yzoo.co.uk
Why you ask? well the script/site was initially written as a project/excersise and I never invisaged getting the traffic that the site is getting and never really planned to sell the script.
When we was getting upto 3000 unique visitors a day the script worked fine but in the past 3 weeks we have actually averaged 5000 unique visitors a day and 6500 visits overall a day. The script is holding up and doing it’s job but it needs to be looked at to see if it can be streamlined. Another problem is limits being put down by the search engines that the script searches for the results:
When using the Google API to get search results you are limited to 1000 queries a day and you are only allowed one API account. Each new query on Yzoo.co.uk makes two queries to Googe via it’s API, the first to check the spelling of the query made and the 2nd to run the actual query.
Yahoo
Yahoo allows you to access their Webservices 5000 a day per IP. In Yahoo’s case the script makes 1 query to one of Yahoo’s Webservices and 2 to another each time a search is carried out.
In addition to the above the script creates ‘html’ sitemaps listing all searches carried out on the site, to ensure these sitemaps do not look like a link farm we limit each page to display x number of searches, this means the script has to create y number of html files and y is growing on a daily basis which means more resources needed.
These setbacks will be resolved!
Greg
Posted in Perl and CGI |