Hi,
I would like a script or program that will split a large TXT file, manipulate the data on each of the 10 split files, and then put it all back together again as a CSV so that I can upload it to my website on a weekly basis. At the moment i am doing it manually and it is cumbersome , repetitive and takes hours. The job itself is simple:
FILE 1.
1. Split up a large file (more than 2 GB and cannot be opened by MS Excel due to row restrictions). This can however be done manually if required using Wonderwebware file splitter. Break it up into files consisting of 1 million rows, which will create about 9-12 files.
2. Automate the process of renaming the headers in the first file.
3. Perform some =IF calculations ( i already have these calculations)
4. Perform some find and replace operations
5. Filter out inconsistent data
6. Delete irrelevant columns
6. Convert columns to the correct formats
7. Merge the files back into one large file and upload it. (again this can be done manually if required)
I am thinking a VBA scrip or possible Macro program should be able to cover it, as the tasks are simple, and repetitive but consistent, except for the first file which must have the headers. I have the FULL sequence of events documented.
There are another two formats that need the same kind of manipulation but would need different sequences of events.
FILE 2
File columns vary from the above file.
1. Split the file (as above)
2. open the CSV, using only certain columns which are predetermined
3. Automate the process of renaming the headers in the first file.
4. Perform some =IF calculations ( i already have these calculations)
5. Perform some find and replace operations
6. Filter out inconsistent data
7. Delete irrelevant columns
8. Convert columns to the correct formats
9. Merge the files back into one large file and upload it. (again this can be done manually if required)
FILE 3:
Onix file - need to get it into CSV format and onto my website (SQL Server 2008)
Repeat steps all steps above, but it is a different file format with different columns, so will require its own script.
Get the file onto my website
Hi Sir, I am new to free lancer. Ill do the first file scripting for free. If you like my work u can pay me for the rest two. Kindly provide me with this oppotunity. I have 3.8 yrs experiance in Macros, VB and vb.net. Thanks in advance.
Hello
I can do this for you, I have expertise in MS Excel/Access and macros.
I have done many projects on this platform. I can do it quickly and accurately and you do not have to make any payment until you are completly satisfied.
Please see my profile and feedbacks.
Regards
Faisal
I have completed hundreds of similar projects using a tool called Perl (practical extraction and reporting language). I believe your project is ideally suited for this tool. Perl has no problem in handling multigigabyte text files; consequently, it would not be necessary to split and rejoin the files after processing. Based in your description I estimate that this project should take no more than 10 hours. The final deliverable would be three executable programs one for each file type. If you could provide me with more specifics on your requirements I would be able to provide a fixed-price bid if you prefer. I have over 15 years experience in performing data reformatting.
Hi
This sort of data manipulation task features regularly in my day job. As a result I am quick to code and aware of the pitfalls of dealing with such vasts quanities of data.
I imagine that it would take between 10 to 15 hours to do the whole task. I would make the macro run as quickly as possible which is important with a file this size. After all you don't want to be waiting 24hrs for excel to do its job which is possible if it is coded badly.
Secondly, you may not need to split the files if you have Excel 2007 up. Since that version can import a txt file up just over 1 million rows. If you are using XL2003 then you will need to split manually. This is not too much extra coding.
Please see my profile and you will see my qualifications.
I am just starting out as a freelancer and to boast my rating quickly I am working cheaply.
Kind Regards
Andy
Hi. I'm very interested in your job. In fact i have good understanding and knowledge in vba macro coding. Have done series of projects with web scrapping, transferring data from/to excel-word, data analysis, files, databases routines.
So feel free to hire me if you want quick and accurate solution.
Regards
Vitali
Dear Sir;
I assure you that I can easily meet most of the mentioned requirements. I have 15 years Vb programming experience. Just give me a chance to fulfill your satisfaction. I can do your job according to your direction, I think. I can guarantee my sincerity, punctuality and honesty.
I am waiting for your valuable response.
Thank you for your time and concentration
I have a masters degree from Arizona State. I have worked in Excel scripting for more than 10 years. I can do this project by using a macro. Also, the macro will be optimized so that it completes fast (does not make your system slow or hang the system.), since the total data size is also big.
Hello, I can do the job for the files of type 1 and 2. As of file 3, if you can send me a sample, i'll try to cope with it too:)
it will take approx 10 hours, but i won't request more than $70.
Best regards, George.