Distributed crawler / crawling system / Web mining project

Closed Posted Feb 25, 2012 Paid on delivery
Closed Paid on delivery

You will (or already have)

1) write a distributed crawler system running multiple crawlers with a command an control (in PHP or Java or Node.JS)

2) eventually crawl over 160M pages of a social network ([url removed, login to view]) and defeat potential crawling roadblocks

3) deliver results in a text comma delineated file(s) based on our data format

You will get:

-Massive cloud computing accounts. There will be almost no limits.

-VK Account Directory

-help from our Engineering team.

You will get paid along the way... so don't worry about that. And this will be fun.

Data Mining Java PHP Web Scraping

Project ID: #1468508

About the project

9 proposals Remote project Active Apr 6, 2012

9 freelancers are bidding on average $1017 for this job

SigmaVisual

We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

$750 USD in 10 days
(235 Reviews)
7.8
akhila27

Check the message and contact us soon. SI Team.

$1500 USD in 45 days
(16 Reviews)
5.5
reco233

Let an expert help you with this, please check your PMB.

$1000 USD in 7 days
(6 Reviews)
5.0
avis009

I Can write the distributed crawler by using scrapy framework, and you can have the output files in .csv format. If you are interested in my offer, please ping us to negotiate. Thanks and regards Srinath

$899 USD in 20 days
(1 Review)
1.0
deathspeeder

I am quite experienced in distributed crawling and I am a Linux developer.

$1000 USD in 30 days
(0 Reviews)
0.0
xtrigonsolutions

Sir, We are ready to work for you. Check PM. Regards, Xtrigon Solutions

$800 USD in 6 days
(0 Reviews)
0.0
googleplus55fcbf

Please check PMB

$800 USD in 10 days
(0 Reviews)
0.0
nwspartners

GETTING PROJECTS DONE UNDER BUDGET! New World Solutions brings together some of the brightest minds in the information technology field. From our pool of multi talented, savvy, goal oriented professionals, we s More

$1000 USD in 10 days
(0 Reviews)
0.0