PebHmong Discussion Forum

Hobbies & Interests => Computer & Technology => Topic started by: darkhelmet on January 27, 2011, 09:24:57 PM

Title: my crawler is at it again
Post by: darkhelmet on January 27, 2011, 09:24:57 PM

Okay some of you know I have a crawler going through PH looking for pictures at http://phpix.freevar.com/ (http://phpix.freevar.com/) which is located on a super slow free webhost (sorry).

So a friend of mine introduced me to this hmong music site called ehmongmusic.co m, which I'm sure most of you have heard or been to.  The sites pretty good with a lot of music files but can't download anything off of it!

Saw a few post about people using software to try to get them and a youtube where this guy shows you how to get it from your cache.  These are all pretty crude way of getting it so I decided to try writing a crawler to retrieve the files for me.

Here's it in action, the crawler automatically creates the a folder and names the files.  Makes it all nice and tidy for me :)

http://www.youtube.com/watch?v=stXEpSxVSEw