« SingleSub v0.1 Released On Comment Spam »
PhpGedView and Excessive Bandwidth
Posted October 24, 2005 – 3:56 pm by Yakov Shafranovich in WebsiteFor the second month in a row, my site has gone over the regular bandwidth quota for no apparent reason. After doing some digging, I found out that over 500 MB was pulled on some days off my site. After even more digging I discovered that majority of this traffic was generated by search engine spiders indexing the geneology section of my site, which was being run on top of PhpGedView. After some time, I found this FAQ entry which recommends putting certain pages into the robots.txt file for exclusion (you can see my list here.
However, I decided to go one step further. In their README (INSTALLATION, section L) they recommend using Gzip compression. However, being that my host (1and1) does not offer it, and enabling it through .htaccess caused errors, I decided to do something else. Following the instructions provided here, I manually edited several PhpGedView files that were not excluded to force them to be compressed. The reason why I want these files to be accessible through search engines is in order so people should be able to discover the geneology info I have. Hopefully, this will help somewhat.
P.S. The files I modified were index.php, indlist.php and individual.php. These contain all the info I have, and are accessible from the index page.
Tags: genealogy, google, phpgedview —
Permalink | Trackback URL | This post has
One Response to “PhpGedView and Excessive Bandwidth”
Interesting. Could you please post information on the files you changed at the PhpGedView Help forum https://sourceforge.net/forum/forum.php?forum_id=185166 ? This way we might be able to turn this into a config setting for those who have hosting issues with Gzipping. Also interesting to note is that fact that MSNBot uses http 1.0 only and does not accept compression.
Thanks
By KosherJava on Nov 1, 2005