Closed

Handle duplicate removals in huge excel files

So we have huge excel files in various formats that we sometimes must double check against each other and remove duplicates from file A that exists in file B. In short we put all the info that will be matched in column A in both files. Then we use to run a MACRO but it takes hours for huge files so we need a better solution. Maybe access or similar?

The files can have different amount of columns from time to time but column A will ALWAYS have the info that will be matched.

So File A) is matched against file B) and the output file will be file A) with all the UNIQUE rows intacs. In other words all the rows that file B) has that matches with file A) are removed from file A) And the rest is output.

I need this done ASAP since we have a file of 1,5 million rows that we need to match agains a file with about 200k rows and I can't use a macro for that since it's too slow.

Skills: Excel, Microsoft Access

See more: software write mq4, software write chip epson, useful software write book, software write web specs, view huge excel files, free software write user guide, software write edid, free software write company profile, merge excel files remove duplicate, software write websites idea, software write book images, software write books, software write protection, free software write book, software write book, software write protect software, code compare excel files find similar items, software write technical manual, lock excel files, access read excel files, code compare excel files, locking excel files, j2ee reading excel files, fetch data excel files, combining excel files

About the Employer:
( 48 reviews ) Solna, Sweden

Project ID: #12186692

61 freelancers are bidding on average €36 for this job

€80 EUR in 1 day
(253 Reviews)
7.6
illuminesoft

We are amongst top 1% global outsourcing providers. We have successfully finished over 430 projects in last 13 years. ID : 12186692 Greetings, We are interested to work on this project, please find my comments i More

€333 EUR in 12 days
(223 Reviews)
7.3
sy3d

we can add match/index formula and it will highlight duplicate rows, so we can remove those please share files, i'll show demo before you hire me thx

€35 EUR in 1 day
(270 Reviews)
7.2
zolayossa

Do you need a one time matching or a code solution? If you want a one time duplicate removal, I can start right away and give you output in an hour.

€23 EUR in 1 day
(114 Reviews)
6.1
gayuh

Hi! I would like to offer my service to handle removal of duplicate rows in the huge excel files. I think the macro you have is not optimized enough to work with the huge number of data, hence the slow performanc More

€30 EUR in 1 day
(93 Reviews)
5.9
€30 EUR in 1 day
(97 Reviews)
6.2
dpune

Hi, I have more than 14 years of Visual Foxpro exp and I am expert in this kind of work. I can build this using Visual foxpro which will be pretty quick. not sure how long macro is taking now ? I have comple More

€30 EUR in 3 days
(114 Reviews)
6.2
macroPOL

Hello, I am Excel and VBA expert. I can create very fast macro. You have a very slow macro. I have a way to make my macro work very fast. I have just done tests on my data. For two files (each about 1 mi More

€39 EUR in 0 days
(61 Reviews)
5.6
oadsmedia

!!! Dear Honor !!! We Can Help You Make That Happen !!!  Let's discuss.............  Choose  wisely!! Cheers :)

€29 EUR in 0 days
(45 Reviews)
5.6
richkumar

Hello, I have experience in excel, data entry work. I can remove duplicate. Please check my portfolio. I can do this project with accuracy. I am ready to start Now. Please review my bid. Thanks. Rich

€19 EUR in 1 day
(70 Reviews)
5.7
MoohHHooM

Hi, i can help you with this project, please let me know more about it :) i may fix your macro so you will get same results in less time, or i will create a tool in VB.NET that can handle this amount of rows in supe More

€29 EUR in 10 days
(25 Reviews)
5.3
priteshkhande88

I am a skilled freelancer who has a working experience of more then 4 year I have working experience on- Web Research, lead generation, data entry, data mining, lead collection, All types of scrapping tools like - da More

€9 EUR in 1 day
(29 Reviews)
5.4
tasleem83

I have gone through the description. I am very much interested to work on your project. I’ll provide you the work as per your requirement with in a particular time frame. So let’s start

€100 EUR in 1 day
(79 Reviews)
5.2
asin1987

Dear Employer, I will automate the process for you using VBAs and MAcros. Please find attached my previous work samples. Please let me know if we can discuss further on this. You can add me on skype as well: as More

€23 EUR in 1 day
(21 Reviews)
5.2
€34 EUR in 1 day
(24 Reviews)
5.1
narsim3128

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 6 years of experience. I have successfully completed few projects for US clients which involved web sc More

€34 EUR in 3 days
(30 Reviews)
4.7
rumarahman

I have 10 years experience with Data Processing in Excel and Web Researching. I work with: Web Search Web Scrapping Excel Access PowerPoint Finance Management Statistics Data Processing Data Collect More

€30 EUR in 1 day
(21 Reviews)
4.7
crypthne

I have bachelor and master degrees in IT. My Primary skills include Java, Python, VB/.NET, ArcGIS, and PHP. Also database skills include MS Access, MySQL, and Oracle. My Other skills include server and network administ More

€30 EUR in 2 days
(27 Reviews)
4.4
Bestever786

Hello dear sir how are you hope you are well Dear sir if you really want 100% Error Free and Quality Data Research and Data Entry Work done Manually or By Tool (Code) Then Please Hire me for this Data Entry Job T More

€30 EUR in 3 days
(11 Reviews)
4.6
KarnMukesh

Hi, Hope you are doing well. I have reviewed the project description and able to start this task which require to check huge excel files of various formats and remove duplicates from file A that exists in file B More

€25 EUR in 1 day
(40 Reviews)
4.4