I need a scrapper to obtain data from Kiva on lenders and borrowers. The data set needs to be obtained in format that is easy to import into current popular statistics software such as Stata, SAS, and SPSS. The data set needs to be organized in an easy to navigate format. The data set needs to have a dummy variable that codes 1 for lender and 0 for borrower. The scrapper will need to be run periodically so it will need to be relatively simple to run and not require the programmer each time it needs to be run. The data set will also need to be accompanied with definitions of the various metrics for reference.
The data I will need is:
• Lender:
o Who they lend to
o What country the lender is from
o The geographic distribution of the borrowers the lend to
o The Gender distribution of the borrowers the lend to
o The sector distribution of the borrowers the lend to
o The partner distribution
o Whether the lender is a member of a team and who the team is
• Borrower:
o Who they borrow from
o How much they borrow
o Funding status
o Repayment term
o Repayment schedule
o Pre-Disbursement date
o Listed Date
o Currency Exchange Loss
o Default protection
o Country the borrower resides
o Currency
o Exchange rate
o Field Partner
• Field Partner:
o Name
o Due Diligence type
o Field partner Risk Rating
o Time on Kiva
o Total loans
o Kiva entrepreneurs
o Interest and fees are charged
o Portfolio yield
o Profitability
o Average loan size
o Delinquency rate
o Loans at risk rate
o Default rate
o Currency exchange loss rate
o Social Performance Strengths
I am not sure what this project will take but the data is well organized on the website on individual profile pages for each lender and borrower. Input is requested on measures that I may have overlooked and professional opinion on the best way to organize this data. The scrapper program will need to be developed on a modest budget as this is for research and the project is limited by my budget. The priority is the borrower and lender data.