Database Research & Development

  • Home
  • NoSQL
    • NoSQL
    • Cassandra
  • Databases
    • Database Theory
    • Database Designing
    • SQL Server Coding Standards
    • SQL Server
    • PostgreSQL
    • MySQL
    • Greenplum
    • Linux
  • Interviews
    • SQL Server Interviews
    • MySQL Interviews
    • SQL Puzzles
  • DBA Scripts
    • SQL Server DBA Scripts
    • PostgreSQL DBA Scripts
    • MySQL DBA Scripts
    • Greenplum DBA Scripts
  • Home
  • Blog Archives !
  • (: Laugh@dbrnd :)
  • Contact Me !
sqlserverinterviews
Home 2015 September Find duplicate records in MySQL

Find duplicate records in MySQL

This article is half-done without your Comment! *** Please share your thoughts via Comment ***

In this post, I am sharing different scripts to find the duplicate records in MySQL.
I found few alternative solutions to find duplicate records in MySQL.
As per your data size, you can choose any one of this solution.

Let’s first create sample duplicate data:

1
2
3
4
5
6
7
8
9
10
11
12
13
CREATE TABLE Employee.tbl_FindDuplicates
(
EmpID INTEGER PRIMARY KEY AUTO_INCREMENT
,FirstName VARCHAR(50)
,LastName VARCHAR(50)
);
 
INSERT INTO Employee.tbl_FindDuplicates
(FirstName,LastName)
VALUES
('Anvesh','Patel'),('Neevan','Patel')
,('Anvesh','Patel'),('Nirav','Shah')
,('Dharma','Teja'),('Nirav','Shah');

First solution using Self Join:

1
2
3
4
5
6
7
8
SELECT
FD1.EmpID
,FD1.FirstName
,FD1.LastName
FROM Employee.tbl_FindDuplicates AS FD1
INNER JOIN Employee.tbl_FindDuplicates AS FD2
ON FD1.FirstName = FD2.FirstName
WHERE FD1.EmpID <> FD2.EmpID

Second solution using SUB Queries:

1
2
3
4
5
6
7
8
9
10
11
12
SELECT
FD.EmpID
,FD.FirstName
,FD.LastName
FROM Employee.tbl_FindDuplicates AS FD
INNER JOIN
(
SELECT
FirstName
FROM Employee.tbl_FindDuplicates
GROUP BY FirstName HAVING COUNT(1)>1
) AS IFD ON IFD.FirstName = FD.FirstName

Third solution using Table Aliases:

1
2
3
4
5
6
7
8
SELECT
FD1.EmpID
,FD1.FirstName
,FD1.LastName
FROM Employee.tbl_FindDuplicates AS FD1
, Employee.tbl_FindDuplicates AS FD2
WHERE FD1.FirstName = FD2.FirstName
AND FD1.EmpID <> FD2.EmpID

Fourth solution using Group BY:

1
2
3
4
5
6
7
SELECT
EmpID
,FirstName
,LastName
FROM Employee.tbl_FindDuplicates
GROUP BY FirstName,LastName
HAVING COUNT(1) >=2;

The above all are different solutions to find duplicate records in MySQL.
As you can choose any one of this but my suggestion is to use the first solution which will perform faster.

Sep 18, 2015Anvesh Patel
Best practice for Primary Key in Database Management SystemDelete all duplicate rows in MySQL
Comments: 1
  1. Rajiv
    September 21, 2015 at 5:39 am

    Nice post !
    This worked for me.

Anvesh Patel
Anvesh Patel

Database Engineer

September 18, 2015 MySQLAnvesh Patel, database, database research and development, dbrnd, MySQL, MySQL Command, MySQL Database Administrator, MySQL Database Designing, MySQL Database Programming, MySQL Error, MySQL Performance Tunning, MySQL Query, MySQL Tips and Tricks
About Me!

I'm Anvesh Patel, a Database Engineer certified by Oracle and IBM. I'm working as a Database Architect, Database Optimizer, Database Administrator, Database Developer. Providing the best articles and solutions for different problems in the best manner through my blogs is my passion. I have more than six years of experience with various RDBMS products like MSSQL Server, PostgreSQL, MySQL, Greenplum and currently learning and doing research on BIGData and NoSQL technology. -- Hyderabad, India.

About DBRND !

dbrnd

This is a personal blog (www.dbrnd.com).

Any views or opinions represented in this blog are personal and belong solely to the blog owner and do not represent those of people, institutions or organizations that the owner may or may not be associated with in professional or personal capacity, unless explicitly stated.

Feel free to challenge me, disagree with me, or tell me I’m completely nuts in the comments section of each blog entry, but I reserve the right to delete any comment for any reason whatsoever (abusive, profane, rude, or anonymous comments) - so keep it polite.

The content of this website is protected by copyright. No portion of this website may be copied or replicated in any form without the written consent of the website owner.

Recent Comments !
  • Anvesh Patel { Sure will do... } – May 27, 12:43 PM
  • Anvesh Patel { Great... } – May 27, 12:41 PM
  • Anvesh Patel { Great... } – May 27, 12:39 PM
  • Anvesh Patel { Great... } – May 27, 12:36 PM
  • Anvesh Patel { Great... } – May 27, 12:28 PM
  • Anvesh Patel { Great... } – May 27, 12:27 PM
  • Anvesh Patel { Great... } – May 27, 12:16 PM
  • Older »
Follow Me !
  • facebook
  • linkedin
  • twitter
  • youtube
  • google
  • flickr
© 2015 – 2019 All rights reserved. Database Research & Development (dbrnd.com)
Posting....