Need a program to auto catch data from a site.

Closed

Hi there.

I need someone to write a program that can auto catch data from this site : [url removed, login to view]

The program is what I [url removed, login to view] the data.

Look at the category list in the right site first.

I need the program can auto catch some categories' data.

From [キングダム] to [横浜線ドッペルゲンガー].

*Check the attachment named “category”

You have to output data in the following way:

Data Structure:

id----order

url----URL of the article

cat----category

title----title

magazine----magazine

author----author

genre----genre

character----character

site----goal website

article----the text

entry_data_at----publish time

created_at----catch time

picture----the cover the article

*Check check the attachment named “tip1,tip2”

Explanation:

[cat],means the name of [url removed, login to view] the category list in the right [url removed, login to view] can see words like [キングダム] and [トキワ来たれり!!],they are categorise.

[title],check the category [キングダム],turns to a new page,you can see words such as [キングダム 最新 492話 ネタバレ&感想 入隊選抜試験と逸材発見!?] or [キングダム 最新 491話 ネタバレ&感想 秦趙決裂と軍備強化], they are titles.

[article],check one title like [キングダム 最新 492話 ネタバレ&感想 入隊選抜試験と逸材発見!?],turns to a new page,you can see an article with lot of [url removed, login to view] have to catch the body which from the title(キングダム 最新 492話 ネタバレ&感想 入隊選抜試験と逸材発見!?) to the end of the article (end at the place above [第491話へ][第493話へ] and advertisements).

[entry_data_at],means the publish time of the articel,for example,the publish time of キングダム 最新 492話 ネタバレ&感想 入隊選抜試験と逸材発見!? is the one written under the title - 2016/10/[url removed, login to view] have to record it by using timestamp,which would turn 2016/10/01 into 1451577600.

[url],means the url of the article,like [url removed, login to view]

[site],all write as [url removed, login to view]

[character],for example,

[url removed, login to view]

You can see words written in blue [第492話 成長への募兵].

In the Developer Tools which is

<span style="font-size: x-large; color: #0000ff;">

<strong>第492話 成長への募兵</strong>

</span>

The number 492 is the [character].

About [author],[magazine],[genre],[picutre],[id] and [created_at],you should do the following step first.

Search any [cat] in [url removed, login to view],use the first result.

For example,search [キングダム] in [url removed, login to view],you can get:

作家:原泰久

雑誌・レーベル:ヤングジャンプ

ジャンル: バトル・アクション / 歴史 / 青年マンガ / アニメ化 / 中国史・三国志

So,

[author],means the words after [作家:]. In the example the [author] is [原泰久].

[magazine],means the words after [雑誌・レーベル:], In the example the [magazine] is [ヤングジャンプ].

[genre],means the words after [genre:],need to use "," to separate them. In the example the [genre] is [バトル・アクション,歴史,青年マンガ,アニメ化,中国史・三国志].

[pitucre],the cover of the first [url removed, login to view] have to catch covers and store [url removed, login to view] the datebase there should add a data bar of [pictuer] and have url of each cover.

[id],means the order, the first one is 1, the second one is 2, etc.(MySQL autoincrement field)

[created_at],means the time you catch the article,also have to record by using timestamp. For example,if I catch the date on UTC/GMT+08:00 2016/10/11 14:40:30, so the [created_at] should be 1476168030.

Use [キングダム] as the example, do what I said,you can get:

id:1

url:[url removed, login to view]

cat:キングダム

title:キングダム 最新 492話 ネタバレ&感想 入隊選抜試験と逸材発見!?

magazine:BE・LOVE

author: ヤングジャンプ

genre: バトル・アクション,歴史,青年マンガ,アニメ化,中国史・三国志

character:492

site:[url removed, login to view]

article:<h1 class="entry-title">......

entry_data_at:1451577600

created_at:1476168030

*Check the explanation named “database sample”.

This is what I [url removed, login to view] have to make the program to catch data in this way to make my server can recognize the data.

Need to catch data 2 hours one time.

Need to send me the program you write to catch data.

Need he full data scraper , also need the program that can catch new data and not catch old data again.

Tap 113114 in your bid.

Skills: Data Entry, MySQL, PHP, Software Architecture

See more: site data search, need program auto voting, need program auto vote, program auto data, need search engine optimisation site wwwlandlordschoicecomau, program auto search, program auto vote site, need program can install search engine using nutch, program auto data forum, auto data input program, delivery sheet data entry program, program auto run using, free site data entry work provider, site data gathering, offline web site data, data structure program, send data excel program, data entry program 2dollar

Project ID: #11818589

Awarded to:

gangabass

I can provide same program as for previous website. Thanks. Roman

$263 USD in 2 days
(310 Reviews)
6.8

11 freelancers are bidding on average $495 for this job

hwanghendra

113114 Hi Sir/Madam. Ready to start. Thanks. Our slogan :  ** What we do, you can find elsewhere ** ** How we do it, makes all the difference **

$444 USD in 5 days
(469 Reviews)
7.3
harish1984

Hello Sir, I have rich experience in PHP/MySQL. I have gone through the details specification of the project, I can do this project as I have rich experience in PHP/MySQL expertise since 7+ years and I have done More

$394 USD in 5 days
(84 Reviews)
6.3
hmshafeeq

Hi, I am interested in your project and would like to offer you my services for 300$. I have built scrapping applications before, few of them are https://www.freelancer.com/projects/php/Grab-public-Facebook-data/ ht More

$266 USD in 7 days
(15 Reviews)
5.9
$555 USD in 10 days
(87 Reviews)
5.5
alliedsoftwares

113114 you need a SCRAPPER Dear Sir, You recently advertised your job posting on this website, we have worked on more than 200 computer softwares, websites / web portals with required APIs & B2B integrations, M More

$5000 USD in 10 days
(11 Reviews)
4.7
aaquibinfi

Hi, I'm Professional Web Scrapping Expert. I'm interested in this project. I can write a program to catch data from the mentioned. I assure you of quality work. Looking forward to hear from you soon. Regards, Alex

$600 USD in 10 days
(20 Reviews)
4.0
alihaider5152

We read your requirement, We know how to do it.Basically you need a data miner and we want you to know that we are very much interesting in your project. Our team consists of some best strategic developers with strong More

$555 USD in 10 days
(9 Reviews)
3.3
yh2013

I have the required expertise for developing your project. Check developed projects and reviews of my portafolio.

$250 USD in 5 days
(7 Reviews)
3.6
vnprofl

Hello. I am a professional scraping bot maker. I have created several scraping bots for my employers. Please see my profile i just completed some similar projects. You will get your project done with the best result if More

$2500 USD in 10 days
(7 Reviews)
3.2
anilvaritas

A proposal has not yet been provided

$277 USD in 3 days
(1 Review)
0.2
notiongate

A proposal has not yet been provided

$800 USD in 10 days
(0 Reviews)
0.0
$986 USD in 10 days
(0 Reviews)
0.0
udhayavanan

Hi I am 4 yrs experienced Web developer (php) and having experience on scrapping nearly 2 yrs. I can scrap the data from any site based on requirement analyzed.

$333 USD in 10 days
(0 Reviews)
0.0