Write script to extract data from published HTML tables into a CSV or JSON standard output

Completed Posted 6 years ago Paid on delivery
Completed Paid on delivery

The website [login to view URL] publishes entrants for sailing races into a set of tables divided by class. A script is needed to process the HTML and extract the data into CSV or JSON format.

The input will be the "regatta ID" and a format modifier (-csv or -json)

Example:

% rnget 12672 -json >> [login to view URL]

An example event is:

[login to view URL]

under the link "Current Registrants"

The specific frame in question is called by:

[login to view URL]

Where the variable to be input is the "regatta_id", in this example 12672

For JSON, the desired schema would be:

{

"Entrant #": "<#>"

"Skipper": "<skipper name>"

"Club": "<club name>"

"Sail#": "<sail number>"

"Boat Name": "<boat name>"

"Fleet / Division": "<fleet/division name>"

"Make/Model": "<make of boat/model of boat>"

"Rating": "<rating #>"

"Date Entered": "<date entry received>"

}

For CSV, the desired output would be:

Entrant #,Skipper,Club,Sail#,Boat Name,Fleet / Division,Make/Model,Rating,Date Entered

Raw HTML looks like this for each entrant:

<tr valign="top">

<td bgcolor="#ffffff" width="15" valign="top"><font face="Verdana, Arial, Helvetica, sans-serif" size="1">1.</font></td>

<td bgcolor="#ffffff" valign="top"><font face="Verdana, Arial, Helvetica, sans-serif" size="1"> Doug Johnstone <br /><br /> </font></td>

<td bgcolor="#ffffff" valign="top"><font face="Verdana, Arial, Helvetica, sans-serif" size="1"> SBYC </font></td>

<td bgcolor="#ffffff" valign="top"><font face="Verdana, Arial, Helvetica, sans-serif" size="1"> 56491 </font></td>

<td bgcolor="#ffffff" valign="top"><font face="Verdana, Arial, Helvetica, sans-serif" size="1"> LeReve </font></td>

<td bgcolor="#ffffff" valign="top"><font face="Verdana, Arial, Helvetica, sans-serif" size="1"> Cruising Class / </font></td>

<td bgcolor="#ffffff" valign="top"><font face="Verdana, Arial, Helvetica, sans-serif" size="1"> Jeanneau / Jeanneau 36 ip </font></td>

<td bgcolor="#ffffff" valign="top"><font face="Verdana, Arial, Helvetica, sans-serif" size="1"> 108 </font></td>

<td bgcolor="#ffffff" valign="top"><font face="Verdana, Arial, Helvetica, sans-serif" size="1"> 07/07/2016 </font></td>

</tr>

This can be written in a common Linux scripting language such as Ruby or Python, or some other efficient scripting language.

HTML JavaScript Python Regular Expressions Ruby

Project ID: #14278024

About the project

50 proposals Remote project Active 6 years ago

Awarded to:

MezbahAlam

Hi, I am Ruby on Rails expert (over 6 years of experience).I can assure you quality of my work. Relevant Skills and Experience My Skills: 1. Ruby 2. Ruby on Rails 3. Git, Bitbucket 4. MySQL , PostgreSQL 5. HTML5 , H More

$155 USD in 3 days
(43 Reviews)
6.0

50 freelancers are bidding on average $117 for this job

ramzitra

Hi, I am Python developer with 6 years experience working on web scraping and data mining as well as building useful scripts for my clients. Relevant Skills and Experience Web scraping Python Proposed Milestones $25 More

$250 USD in 3 days
(534 Reviews)
8.8
gangabass

I can create such script using Python in less than a day. It will output JSON or CSV just like you want. Thanks. Roman Relevant Skills and Experience I have huge web scraping experience that's why I'm sure you'll be More

$98 USD in 1 day
(522 Reviews)
7.9
lkhelladi

Hello, I'd be glad to develop a python software that extract desired data for you. Looking forward to chat with you soon for more details. Best regards, Relevant Skills and Experience Python , web scraping More

$83 USD in 3 days
(205 Reviews)
8.0
mantislin

Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/script More

$130 USD in 3 days
(174 Reviews)
7.5
vuyiswankosi

I can complete the task you need in 1 day or less. I will be using "beautifulsoup4" which is a python HTML DOM manipulator that can work with python 2 and 3. Update: I've attempted the program and managed to complet More

$150 USD in 1 day
(67 Reviews)
7.6
kishanlalyadav

HI SIR AWARD ME RIGHT NOW I M 100% CONFIDENT FOR THIS PROJECT!!! Stay tuned, I'm is still working on this proposal.

$193 USD in 3 days
(302 Reviews)
7.0
thewebscraper

hi i am an expert webscraper. i can easily extract data and save it in the format you require. this is pretty straight forward. should be done in less than 2 days.

$111 USD in 3 days
(77 Reviews)
6.6
masterlancer999

Hi I am very experienced in web scraping using Python I already read through your requirements, and I am sure I can complete this in 1 day Please message me Thanks Relevant Skills and Experience Python, Web scraping More

$166 USD in 2 days
(33 Reviews)
6.3
abhi143u11

Dear client I have done similar kind of projects I would like to work on this project

$111 USD in 3 days
(71 Reviews)
5.8
grastko

Hello, my name is Rastko and I'm a Python developer, very experienced in web scraping (scraped over 150 websites), so I'm interested in your job offer. I don't take jobs for which I'm not sure I could finish suc More

$90 USD in 1 day
(41 Reviews)
5.1
codetastic

Hello, I am an experienced python coder with expertise in data processing. I would be happy to assist. Regards, Erik Relevant Skills and Experience I have extensive experience with data processing applicatio More

$100 USD in 2 days
(15 Reviews)
5.2
camper2020

Hi I have a lot of experience in all things web and can write a PHP script that can parse the requested HTML into both JSON & CSV. You just need to be able to host the script. Can be done today. Relevant Skills and Ex More

$55 USD in 1 day
(20 Reviews)
5.1
Beacon09

Hi Understood provided details. I can create a PHP script that will take input regatta ID and desired output format (CSV/JSON), and will output the result in that desired format. I am detail oriented and I striv More

$112 USD in 3 days
(28 Reviews)
4.9
josefN

Hello, I can do this quickly in python. Just let me know. Relevant Skills and Experience python, web scraping Proposed Milestones $50 USD - milestone

$50 USD in 1 day
(43 Reviews)
5.3
anqxyr

I can do all the requirements outlined in the project's description, json and csv output included. The work will be done in Python3. If you require it to be done in Python2, that'll be $20 extra. Relevant Skills and E More

$80 USD in 3 days
(18 Reviews)
4.8
bhagwansahane89

Data scraping expert

$50 USD in 1 day
(19 Reviews)
4.9
andy93

Hi, It's an interesting project you've got. I would like to provide you with a solution for scraping regatta registrants. Since the page is not dynamically loaded we can indeed use simply python like you suggested More

$200 USD in 7 days
(5 Reviews)
4.5
mmpatel009

Hello, Hope you are doing well. I have more than 5 years of experience in web development. please initiate message board so we will discuss it. Thank you

$100 USD in 2 days
(25 Reviews)
4.3
DrDri

Hello Sir, I can do the job in one day, if there's any problem I'll take two days mac, I can start working right now. Relevant Skills and Experience python, scraping, automation, I support after development .. Propo More

$77 USD in 2 days
(8 Reviews)
4.6
vikas8530

I have good work experience with web scrapping in python and node js. Relevant Skills and Experience Have done 3-4 projects like this (all are private projects so can't show them to you) Proposed Milestones $111 USD More

$111 USD in 1 day
(4 Reviews)
4.0