Find Jobs
Hire Freelancers

data lake

$250-750 AUD

Closed
Posted about 7 years ago

$250-750 AUD

Paid on delivery
We have over 3 million consumer records containing the following data fields: name address state city postcode sex dob time stamp Ip address and about 7 other fields We need a centralised location to store the data. We need to be able to query the data on all of those data fields. I would like to be able to give multiple postcodes and have the system identify those records that meet those postcodes. phone number look up. deduplication. I would like to run a query on 1 million+ phone numbers and have the system tell me if we have unique numbers from that data or duplicates. Let me know if this can be built?
Project ID: 13195450

About the project

31 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
31 freelancers are bidding on average $469 AUD for this job
User Avatar
Hello I am interested in your project and would like to discuss the project with you. We always deliver on time and on budget check our feedbacks. 100% satisfaction guarantee and Quality Sales support 24/7. Please check our Reputation in freelancer have done more then 150 jobs. https://www.freelancer.com/u/CodeWolves.html Thank You Christopher Cox
$1,000 AUD in 7 days
4.8 (160 reviews)
7.7
7.7
User Avatar
HI Contact me for an efficient, perfect, well documented development of your project according to 100% accuracy and requirements, with dedicated support. Thanks Farah Saif
$250 AUD in 10 days
4.9 (401 reviews)
7.2
7.2
User Avatar
I can convert the data in to an online protal with search functionality which will be easier for your search functionas
$333 AUD in 10 days
4.8 (128 reviews)
7.4
7.4
User Avatar
Hello, I have gone through your outsourced requirements "data lake" and have analyzed that I have right skills (Data Science, Data Warehousing, Database Development, Database Programming, PHP) to execute your esteemed project. I will complete your project within 2 weeks, LIFETIME error free guarantee and provide 365 days (ONE YEAR) support... ===== Why choose me? ===== 5.0 / 5.0 rating, 100% completion rate, 100% on-time completion, 100% on-budget :) Kindly, check my profile: http://www.freelancer.com/u/BitLabs.html I work smart, hard, and strictly bid only what we can do! No sub-contracting... ever! You will never go wrong choosing me :)
$498 AUD in 365 days
5.0 (113 reviews)
6.7
6.7
User Avatar
Hello I have gone through the details of your project and we find it well within our capabilities. I will give you 100% quality work As your need , we will Ready To start work,I can create and deliver the project very excited to assist you in making your Sites successful – please feel free to contact me directly to discuss this as per the information.I have skilled, expert programmers I'm position further. Waiting for your message then will start work immediately Thanks
$255 AUD in 11 days
4.7 (49 reviews)
5.4
5.4
User Avatar
Hello, For this project I would build a Postgres database; it is opensource, has libraries for many programming languages and I have used it successfully for many projects including fairly large datasets (hundreds of GBs and billions of rows). Since you need to query on all fields we can use JSON which is well supported in Postgres. I also have experience with Python, Linux, networks, cloud platforms and I think these skills will come in handy. Best wishes, iticus
$400 AUD in 4 days
5.0 (15 reviews)
5.1
5.1
User Avatar
Greetings! I'm an PHP developer with long time expertise in enterprise class projects. I have a few questions about the project details: Do you have any preference about the RDBMS used for storage? What amount of simultaneous users do you expect for the DB? How many queries (approximated or estimated) you intend to run per hour on the data?
$288 AUD in 10 days
5.0 (21 reviews)
5.1
5.1
User Avatar
Hi Dear I have a lot of experience in DataBases ,Data Warehous,DB2 , Teradata etc . I am DataBases + Warehouse certified from Oracle,postgresSQL,SQL SERVER , Access. I have done many work in Requirements analysis , Data Staging, Data Warehouse, DataBases. I am expert in developing ERD, Front-End, Backend, Security, Optimization, SSIS, SSRS. I have strong command on queries too.I see your work & too much interesting in your work. My rates is also too much low. I assure you I am the best for your work. Kindly reply me so that we negotiate on price & then start working on it Have a good day Thank you
$250 AUD in 10 days
4.9 (21 reviews)
4.7
4.7
User Avatar
Hi, I read the project description and this is what I think we can do. We can create a relational database using MySQL to store all the records you have. We can host this db on amazon webservice. They provide good server for faster processing. We will write the database procedures to add, retrieve, update , delete and duplicate check the records from the databases. You can run all these procedure easily using several input parameters like date range , code, phone number, etc. I have over 7 years of experience as a MySQL and oracle database developer. Depending on the budget we can use oracle as well but if you want to use MySQL that's no issue as well. I can start now.
$600 AUD in 6 days
5.0 (9 reviews)
4.6
4.6
User Avatar
Hello! I'm sure I can help you. I have about 20 years of experience in database-oriented applications development. All features you want can be done. Your records have to be converted and normalized in order to implement some of the features. I have a lot of questions about the project. 1. What is the source of your consumer records (format in which they are stored now). 2. These records are static or will be updated from the source in future? 3. What kind of user interface do you want for look up/deduplication operations? Web based or desktop? If you are interested we can discuss the project details on the chat. Thank you for your attention. Roman.
$250 AUD in 3 days
5.0 (22 reviews)
4.4
4.4
User Avatar
You need to create a database for this purpose. That database will have all the functionality query, enter data, import / export data, reports of you choice and much more as per your requirements. Please reply this massage for more discussions.
$250 AUD in 10 days
4.9 (10 reviews)
3.5
3.5
User Avatar
Hi I would gladly help you with this query. But please answer that questions: 1) What kind of database do you use? how is the source. 2) Do you have relational database? if not can I transfer it in relational database to have multiple postcodes? 3) What kind of environment do you use? I propose you to have this data into relational database, reorganize into two tables (main data and postcodes) and run query for de-dup. You may find my price high, but of course you don't want to waste your time because if you hire low paid programmer it will take long time and you will not get work done. Looking forward to reply from you. Archil
$600 AUD in 2 days
5.0 (1 review)
3.2
3.2
User Avatar
Hello , Are you there ? . now I'm here . yes. . I would like to work with you . we can discuss more about the project . therefore can you talk with me ? .
$388 AUD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, We are a team of specialists in information technology field we have experiences in varied range of software languages, tools and databases. We can guarantee you best results in the specified time. We can make one database to store all your data also will develope a program to manipulate your data (add,edit,delete and query your data as needed ). also the program will have some other advantages like login screen and advanced privilege system that allow only authorized user to do specific functions. If you would like I can show you some of our work . The project may be divided into 4 stages that can be discussed later. You are welcomed to contact me any time. Yours faithfully
$555 AUD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
im best at databased programming, pls hire i will do my best for you. im a college at Telkom University, Indoesian
$277 AUD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear Sir I'm creative Freelancer and develop my career in IT field. I love & like to take challenge. I am a hard working person. Hard working is my habit. I have expertise on wordpress, Magento, CRM, e-Commerce, Woo Commerce, Inventory Management, Database, MYSql, SQL Server, Oracle, PHP,HTML,CSS with website designing. I have enough knowledge in Data Entry, MS word, Excel, MS Access, HTML, CSS, Database, Joomla, Basic Photoshop and other programming language. I'm very interested in your job post involving these skills. I am available to chat by email or Skype(hossainmd94), and would be happy to set up a convenient time to discuss the application you're moving and some ideas about the safest way to get it into the cloud. I will be available 40 hours per week for this position. Regards, Hossain
$555 AUD in 15 days
0.0 (0 reviews)
0.0
0.0
User Avatar
A proposal has not yet been provided
$555 AUD in 30 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have the skills necessary to make the project, but i need more information about, for example, have you a template, framework or other required? Best regards.
$666 AUD in 14 days
0.0 (0 reviews)
0.0
0.0
User Avatar
A proposal has not yet been provided
$305 AUD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Simple to build! You can create a MySql or Microsoft Access database and put it on one of your company's server or your own desktop (A bit risky if your computer breaks). Define the columns. Import the data as a CSV file. Connect to the database using Access or a SQL client like TOAD. Put Indexes on the columns that you want to search on, ie telephone number or postcode. This will speed up searching dramatically. Write a few parameter queries that you can run that accept string inputs with wildcards ie for telephone number you can enter 01782* and it will bring back all records beginning with 01782. SELECT* FROM tbl_customers WHERE telephoneNumber like :p_tel_no This will display an input box that asks for an input. Write a query that returns all duplicate telephone numbers using HAVING COUNT(*) > 1 in the WHERE clause of a query. You be able to export your results in a csv file that can be loaded into Excel. Hopefully, your address field will be normalised into address1, address2 etc as just searching on address will be slow.
$555 AUD in 10 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of AUSTRALIA
Mermaid Waters, Australia
0.0
0
Payment method verified
Member since Dec 5, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.