Find Jobs
Hire Freelancers

Scraper API for Auction Site

$250-750 USD

Completed
Posted almost 9 years ago

$250-750 USD

Paid on delivery
I am looking for someone to build a Java API to enable interaction with a particular website. I will reveal the details of the site and API spec to those who contact me but for the sake of getting a better idea about the project, one could think of the site as a kind of auction site. The API would need to: 1. “Login” to the site to establish an authenticated session. Subsequent API calls should use those session credentials rather than re-login on each call. 2. Enumerate the list of outstanding auctions. The enumeration would contain: a. human readable name of the auction b. site ID for the auction c. verbose description for the auction d. expiry for the auction 3. Given a site auction ID enumerate the outstanding bids made by participants 4. Given a site auction ID make a bid on the auction 5. Given a site auction ID enumerate the bid(s) made by the user (API) on that auction. The enumeration would include a. price b. a bid ID c. status 6. Given a bid ID query the status which could be: a. won b. lost c. pending. 7. The API must be thread-safe i.e. reentrant allowing multiple threads to make parallel request on both the same and different login ID’s and locking should be minimal to allow a high degree of parallelism 8. Should optionally be able to direct requests through a standard http(s) proxy server which should be configurable on a per-session (i..e per login) basis. 9. Note that this is a 2.0 web site so the project will be more involved that just parsing HTML for links and calling those. 10. I assume there are Java automation frameworks to assist this with (example [login to view URL]) 11. I have a strong preference towards Java for this but could be convinced to accept a python implementation provided that the implementation included a SOAP interface and a Java stubs to call the API via SOAP. The above is “rough” and the actual project from a programming perspective should be similar in scope to the above but some pretty big differences. I’m looking for someone who has: a. experience building applications that scrape/control website programatically b. many years experience developing java applications - I’ve been developing in Java for years and will know right a way if this is one of your first Java programs (even if it works perfectly) and most likely give you a bad review. b. is able to complete the project for $200 (I will consider paying a bonus for exceptional work) If interested, please send me a message outlining relevant project experience and I’ll send specifics about the site and API.
Project ID: 8165787

About the project

6 proposals
Remote project
Active 9 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi there. As I understand, you want to build an interface as if it was a real API provided by the site's owner, but instead the API will use scraping techniques to communicate to the server via their webpage. I specialize in web scraping but I always use the Scrapy framework, which is written in Python. Either way, this means I'm proficient in all the technologies required for scraping as HTTP, HTML, CSS selectors, AJAX, regular expressions, etc. On the other hand, I have worked with Java for many years (I can show you some open source projects I have); just not for web scraping. I would gladly study a Java framework for HTML parsing (jsoup definitely seems to be the most popular one) for your project, but this might mean that I will need a little more time than someone who already works with web scraping in Java. Anyway, feel free to contact me.
$300 USD in 10 days
5.0 (8 reviews)
3.2
3.2
6 freelancers are bidding on average $382 USD for this job
User Avatar
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
$330 USD in 6 days
4.9 (115 reviews)
6.7
6.7
User Avatar
Hi there, I’d like to be considered for your programmer position. I’m an Access/VBA developer with a strong background developing a wide range of accounting, economical, statistical and mixed type projects using Ms Access, Ms Excel, VBA, ADO, SQL, Web scraping including projects for start-up companies and small businesses For over the last 20 years I’ve worked in a variety of industries. I have a deep passion for coding and guarantee that all of developing is 100% original. I highly value professionalism and hold myself strictly accountable to represent my client’s brand. I aim to form a long-term working relationship. Please, let me know what is needed to secure this bid! Thank you for your consideration. Zura
$555 USD in 10 days
5.0 (3 reviews)
3.9
3.9
User Avatar
Hi, I am interested in this project, I am am experienced professional in this domain, moreover this is my day to day job I.e. automation using java.
$333 USD in 5 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of HONG KONG
Tsuen Wan, Hong Kong
5.0
5
Payment method verified
Member since Apr 2, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.