Command line tool to process a CSV file and generate stats into an output csv file
$30-250 USD
Completed
Posted about 8 years ago
$30-250 USD
Paid on delivery
We need a command line tool (no GUI) that will include input file with fields:
company, domain, namefirst, namemiddle, namelast, title, email1, email2
Other fields may be present, ignore them
The app will have 2 functions on the command line
FUNCTION 1 -stats
The input file will be sorted on domain. The tool should process the input file as a stream of data and for each email, determine the email pattern. Patterns include
FLast (example MSmith@domain)
First (example Mike@domain)
Last (example Smith@domain)
FirstLast (example MikeSmith@domain)
[login to view URL]
First_Last
[login to view URL]
F_Last
FirstL
First.L
First_L
[login to view URL]
FMLast
LastFM
FL
Other (not matching any pattern)
After each group of emails by domain is processed for email format. Output one line that summarizes emails format stats for that domain.
Output file should be named the input file name + "-Email-Pattern-Stats". Output should be .csv file with labels:
Company
Domain
Count (for each email format found)
Percent (for each email format found)
example: Flast, Flast%, First, First% (pairs of stats, 1 for each pattern)
FUNCTION2 -winner
The same process as detailed above: In this case, stats will be generated but not output. The stats will be used to pick a winner between email1 and email2. The winning email will be the one that has the higher matching percent. If a tie, email1 wins.
Output will be exactly the same as the input file with two fields added:
Email-Winner ( 1 or 2)
Winning-Email (the winning email)
The application should be able to handle large input files with millions of lines.
To show that you read this entire description. Put the name of your favorite animal in CAPS as the first line of your proposal/bid. Good questions that show you read the requirements will get a response.
We use C#, which is preferred, but not required. Suggest what you want to write this in. The user of this application will be non technical person using windows desktop machine.
A sample file similar to what we want to process is included
CAT
Hello....I love to program in c/c++ since 22 years ago...you can see my profile and previous works... also, I have master and PhD in computer science... I should be a good option for this project. So, let me do it. Best regards!
The system is simple and do able with 100% accuracy, i can design in command line and with a simple and interactive GUI using C# as well, kindly contact me because i can deliver this system in day or two :)
I have made a small software for a casino but can't share it because i sign agreement of non-disclosure
I can code this using power shell which is based on c# only and is built in all the windows starting from windows vista and above
I can also code this tool in c# and will make it extremely user friendly.
Thanks and Regards,
Benjamin Joseph
Sir,
I am well versed in this kind of jobs and can do your project as per requirement.
I have over 8 years of experiences and will deliver flawless work.
I am very much able to work on this. ***I am ready to start
Waiting for further discussion..
with thanks and regards
CAT
I'm software developer and I've experience in .Net programming using C#. Also I'm familiar with parsing files and csv is one of them .
I'm really interested to work on that project
I did a lot of CSV manipulations and stats here at freelancer.com - you can check my profile.
this can be delivered in 1 day, but I am writing 3 in the proposal just in case.
this will be command script taking 1 input and generating 2 outputs.
Dear Sir
I have read your job description carefully.
This is easy for me.
I am good in data processing and Excel file treatment.
I have many experience in VBA marcro as well as C# interope or openxml.
I hope to discuss more.
Thanks
PARROT
Hi, I think I understand the first requirement but I'm not sure about the second one. As I get it, the matching percent is calculated per domain and per format; but the winner is an individual email address? Maybe, if you can include a short example of how to pick a winner from a small data set, I can see it.
Also, what do you mean by "stats will be generated but not output"? Don't both functions need to dump their results to a CSV file?
Finally, regarding the technology, I can write this with Python or Java; sadly I don't know C#. Python would be my prefered choice (faster to write and easier to install on your side), but any of them is good.
Regards.
CATS
Hi there, I know how I could solve your problem. I would probably do it using a naive search algorithm. I'd do it in C#.
Just to make sure, for the 'winner' functionality, for every line in the input file, if the format of email1 corresponds to a format which has a higher percentage (in that domain) than email2, pick that one. Right?
As a bonus, I could also make a GUI application on top of the core code in case it could be of any use to you. But only if it might be of some interest to you.
Regards
Hi,
Hope you are doing well. I have been working in .net and asp.net for last 5 years
I have already a similar system like this. Let me know.
I look forward to a personal interview at your convenience.
Thanks
GOLDFISH
Questions about Project:
1). Although the example file does not appear to contain any domain-name errors (for example, missing suffix, like .com), does the domain need to be validated prior to inclusion in output?
2). Are combinations of Middle and Last Names only (no First Name) deliberately excluded from successful matching patterns?
3). In the example file, email2 is much more sparse relative to email1. Is the matching percentage based on individual counts? i.e., email1_matching_percentage = 100 * email_1_matching_count / email_1_total_count vs. email2_matching_percentage = 100 * email_2_matching_count / email_2_total_count. There may be a pre-existing, strong bias toward/against email2, as it has a much lower total count. Is this desired? Perhaps a much lesser biased comparison is to only compare email1 and email2 matches only when email2 exists. In this way, the total count is the same. Is this better?
My proposal:
A python program to process the CSV input file and deliver the outputs as described. Advantages of using python for this project:
* portable across a variety of OS/computing platforms.
* convertible to a native .exe program binary using a python tool to generate a binary.
* dragging functionality on Mac and Windows desktops to make it user-friendly.
DOG
1. I prefer to implement this command-line tool in C++, but if C# is a mandatory condition, I can use C# also, just using C++ will be faster for me.
2. I carefully reviewed the specification and sample file , I am sure I can deliver it in 1 day using C++. I think the specification is very clear for me.
