Closed

Crawl Weixin (WeChat) and Weibo data

Hi all

I would like to be able to build up a database of Weixin and Weibo posts.

You would use scrapy to do this. The data would be saved via the Django ORM.

We would run the crawls regularly (possibly once per week), and only new data would be saved in the database.

We would need to save the timestamp, message, username (if possible).

Must be able to save both English and Chinese.

Ideally you would be available for continuous improvements and maintenance.

Thanks for reading.

Skills: Python, Web Scraping

See more: http wwwgetafreelancercomprojectsdata processing data entrycaptcha worker need fromhtml, speak fluent english need subtitle, english need style, https github com resolvewang weibospider, python requests post github, web crawler github, github celery task, web crawler python github, github celery celery, github com python requests, requests python3 github, python, web scraping, django, apple logic pro, scrapy, web scraping web search, translate excel data arabic english, data base tables need online ordering system, data persian english

About the Employer:
( 8 reviews ) Hong Kong, Hong Kong

Project ID: #17202604

18 freelancers are bidding on average $1031 for this job

phpXpertbd

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database More

$1116 USD in 15 days
(65 Reviews)
7.2
chirgeo

Hi. I would like to discuss more details about the project. I set for now a higher bid price to see all the big picture before we can discuss that. As I understand we need to login into those chat app and do More

$2000 USD in 10 days
(99 Reviews)
7.1
bluediscover

Hi, I have been developing in python for over 7 years. I have hands-on experience in Django during my former projects. For periodic crawling job, I use celery beat with broker. I love to use Django ORM as it is More

$1000 USD in 10 days
(54 Reviews)
6.8
bestit4u

[login to view URL] I am very interested in your project, because I have much experience in such projects. I have good skills with the program language including C/C++, C#, java, php, asp.net, python, VB.NET. So I have expert an More

$1116 USD in 10 days
(74 Reviews)
6.8
fatimatuzzohura

Hi, I have great experience on web scraping and automation. Will write a Python script to extract the requested data . Thanks

$1333 USD in 10 days
(92 Reviews)
6.0
$555 USD in 10 days
(98 Reviews)
6.4
shinelancer

how are you? I understand your requirements and I can strongly assure you that i will complete this job according to your requirements. Kindly Contact me in inbox to discuss in detail. As I am python expert, I have More

$800 USD in 7 days
(18 Reviews)
5.1
damilareisaac

H there, I have read through your project description, I can satisfy the requirement in the speculated time. Please contact me on PM for details. I will be willing to work with you on a long term basis.

$250 USD in 10 days
(19 Reviews)
4.6
WIFTCAP

Hi !! Nice to E-meet you We have a team of experienced python, django developers. We have developed a sophisticated trading platform ([login to view URL]) using python, django, postgresql. Our python/django de More

$400 USD in 10 days
(12 Reviews)
4.3
MyAwesomeTeam

Nice to see you, stevebranding. Do you need to be able to build up a database of weixin and weibo posts and save the timestamp, message,you ername (if possible) ?.I have the ability to do it We have ex More

$1205 USD in 3 days
(11 Reviews)
4.5
arjun366333

Ready to start the work to make the scrapper in python for scrap the data from Weixin and Weibo posts. data base and store using the django ORM ,please check my recent similar work ,we can discuss more over chat,thanks More

$444 USD in 10 days
(9 Reviews)
4.3
vdvaxel

Hi there! I have done web scraping before using Python for my previous Freelancer.com project, so I am sure I can help you out. Can you send me the details via chat? Cheers!

$500 USD in 3 days
(13 Reviews)
4.2
ts199756

Hi. I am a python developer with extensive experience in building web crawling and data Scrapping softwares. I use Selenium and beautiful soup for building crawlers to extract specific part of information from websit More

$1444 USD in 20 days
(2 Reviews)
2.9
athminteam

Hello, We are a team of IITians having more than 8 years of experience in Python, Web Scraping, Statistics, Software Architecture and much more. We can help you with this project. Kindly connect to discuss in detail a More

$1116 USD in 10 days
(1 Review)
2.1
$2000 USD in 10 days
(0 Reviews)
0.0
YuKai7777

Hello, I am freelancer [login to view URL] for your cool offering. I have read your project description carefully and it is very interesting to me. I have 3+ years of experience in python with 2 years in django. Here is my More

$1116 USD in 10 days
(0 Reviews)
0.0
RoppeBoi

Hello! I see you are having an interesting job for me! Why should you give me this job assignment? I am a really experienced python programmer and I can assure that my work will always be the best possible qualit More

$1112 USD in 9 days
(0 Reviews)
0.0
$1055 USD in 10 days
(0 Reviews)
0.0