46
Computer & Technology / my crawler is at it again
« on: January 27, 2011, 09:24:57 PM »
Okay some of you know I have a crawler going through PH looking for pictures at http://phpix.freevar.com/ which is located on a super slow free webhost (sorry).
So a friend of mine introduced me to this hmong music site called ehmongmusic.co m, which I'm sure most of you have heard or been to. The sites pretty good with a lot of music files but can't download anything off of it!
Saw a few post about people using software to try to get them and a youtube where this guy shows you how to get it from your cache. These are all pretty crude way of getting it so I decided to try writing a crawler to retrieve the files for me.
Here's it in action, the crawler automatically creates the a folder and names the files. Makes it all nice and tidy for me
So a friend of mine introduced me to this hmong music site called ehmongmusic.co m, which I'm sure most of you have heard or been to. The sites pretty good with a lot of music files but can't download anything off of it!
Saw a few post about people using software to try to get them and a youtube where this guy shows you how to get it from your cache. These are all pretty crude way of getting it so I decided to try writing a crawler to retrieve the files for me.
Here's it in action, the crawler automatically creates the a folder and names the files. Makes it all nice and tidy for me