Handle duplicate removals in huge excel files

So we have huge excel files in various formats that we sometimes must double check against each other and remove duplicates from file A that exists in file B. In short we put all the info that will be matched in column A in both files. Then we use to run a MACRO but it takes hours for huge files so we need a better solution. Maybe access or similar?

The files can have different amount of columns from time to time but column A will ALWAYS have the info that will be matched.

So File A) is matched against file B) and the output file will be file A) with all the UNIQUE rows intacs. In other words all the rows that file B) has that matches with file A) are removed from file A) And the rest is output.

I need this done ASAP since we have a file of 1,5 million rows that we need to match agains a file with about 200k rows and I can't use a macro for that since it's too slow.

Ferdigheter: Excel, Microsoft Access

Se mer: software write mq4, software write chip epson, useful software write book, software write web specs, view huge excel files, free software write user guide, software write edid, free software write company profile, merge excel files remove duplicate, software write websites idea, software write book images, software write books, software write protection, free software write book, software write book, software write protect software, code compare excel files find similar items, software write technical manual, lock excel files, access read excel files, code compare excel files, locking excel files, j2ee reading excel files, fetch data excel files, combining excel files

Om arbeidsgiveren:
( 42 omtaler ) Solna, Sweden

Prosjekt-ID: #12186692

63 frilansere byr i snitt €35 for denne jobben


We are amongst top 1% global outsourcing providers. We have successfully finished over 430 projects in last 13 years. ID : 12186692 Greetings, We are interested to work on this project, please find my comments i Mer

€333 EUR på 12 dager
(221 omtaler)
€80 EUR på 1 dag
(248 omtaler)

we can add match/index formula and it will highlight duplicate rows, so we can remove those please share files, i'll show demo before you hire me thx

€35 EUR på 1 dag
(253 omtaler)

Hi, I have more than 14 years of Visual Foxpro exp and I am expert in this kind of work. I can build this using Visual foxpro which will be pretty quick. not sure how long macro is taking now ? I have comple Mer

€30 EUR på 3 dager
(98 omtaler)

Hello, I am Excel and VBA expert. I can create very fast macro. You have a very slow macro. I have a way to make my macro work very fast. I have just done tests on my data. For two files (each about 1 mi Mer

€39 EUR på 0 dager
(51 omtaler)

Do you need a one time matching or a code solution? If you want a one time duplicate removal, I can start right away and give you output in an hour.

€23 EUR på 1 dag
(87 omtaler)
€30 EUR på 1 dag
(59 omtaler)

Hi! I would like to offer my service to handle removal of duplicate rows in the huge excel files. I think the macro you have is not optimized enough to work with the huge number of data, hence the slow performanc Mer

€30 EUR på 1 dag
(67 omtaler)

I have gone through the description. I am very much interested to work on your project. I’ll provide you the work as per your requirement with in a particular time frame. So let’s start

€100 EUR på 1 dag
(69 omtaler)

Hello, I have experience in excel, data entry work. I can remove duplicate. Please check my portfolio. I can do this project with accuracy. I am ready to start Now. Please review my bid. Thanks. Rich

€19 EUR på 1 dag
(55 omtaler)

Hi, i can help you with this project, please let me know more about it :) i may fix your macro so you will get same results in less time, or i will create a tool in VB.NET that can handle this amount of rows in supe Mer

€29 EUR på 10 dager
(15 omtaler)

I have 10 years experience with Data Processing in Excel and Web Researching. I work with: Web Search Web Scrapping Excel Access PowerPoint Finance Management Statistics Data Processing Data Collect Mer

€30 EUR på 1 dag
(10 omtaler)

I have bachelor and master degrees in IT. My Primary skills include Java, Python, VB/.NET, ArcGIS, and PHP. Also database skills include MS Access, MySQL, and Oracle. My Other skills include server and network administ Mer

€30 EUR på 2 dager
(16 omtaler)

Lest's start work with great accuracy and with in time deadlines .My aim is to satisfy my client by my WORK.Thanks.

€12 EUR på 1 dag
(14 omtaler)

Hi, I am an expert in MS Excel, MS Access, SQL database production and management. I have over 7 years of experience in working with all of the databases and analytics. I am a financial engineering graduate and have e Mer

€10 EUR på 1 dag
(11 omtaler)
€34 EUR på 1 dag
(7 omtaler)

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 6 years of experience. I have successfully completed few projects for US clients which involved web sc Mer

€34 EUR på 3 dager
(16 omtaler)

Hello There, Here are some of my work examples. Project Report Automation - [url removed, login to view] Log Report Automation - [url removed, login to view] Mer

€40 EUR på 2 dager
(6 omtaler)

Hi, I can help with that. Possible solution would be to convert that files into ms access and run small tool that will perform duplicate checking and remove duplicates and after would reconvert into excel. Regard Mer

€50 EUR på 0 dager
(9 omtaler)

Hi, Hope you are doing well. I have reviewed the project description and able to start this task which require to check huge excel files of various formats and remove duplicates from file A that exists in file B Mer

€25 EUR på 1 dag
(19 omtaler)