zoukankan      html  css  js  c++  java
  • oracle中查找和删除重复记录的几种方法总结

    平时工作中可能会遇到当试图对库表中的某一列或几列创建唯一索引时,系统提示 ORA-01452 :不能创建唯一索引,发现重复记录。

    下面总结一下几种查找和删除重复记录的方法(以表CZ为例):

    表CZ的结构如下:

    1 SQL> desc cz   
    2   Name Null? Type   
    3   -------------------------------------------------------------------   
    4   C1 NUMBER(10)   
    5   C10 NUMBER(5)   
    6   C20 VARCHAR2(3) 

    删除重复记录的方法原理:

    (1).在Oracle中,每一条记录都有一个rowid,rowid在整个数据库中是唯一的,rowid确定了每条记录是在Oracle中的哪一个数据文件、块、行上。

    (2).在重复的记录中,可能所有列的内容都相同,但rowid不会相同,所以只要确定出重复记录中那些具有最大rowid的就可以了,其余全部删除。

    重复记录判断的标准是:

    C1,C10和C20这三列的值都相同才算是重复记录。

    经查看表CZ总共有16条记录:

     1 SQL>set pagesize 100   
     2   SQL>select * from cz;   
     3   C1 C10 C20   
     4   ---------- ---------- ---   
     5   1 2 dsf   
     6   1 2 dsf   
     7   1 2 dsf   
     8   1 2 dsf   
     9   2 3 che   
    10   1 2 dsf   
    11   1 2 dsf   
    12   1 2 dsf   
    13   1 2 dsf   
    14   2 3 che   
    15   2 3 che   
    16   2 3 che   
    17   2 3 che   
    18   3 4 dff   
    19   3 4 dff   
    20   3 4 dff   
    21   4 5 err   
    22   5 3 dar   
    23   6 1 wee   
    24   7 2 zxc   
    25   20 rows selected. 

    1.查找重复记录的几种方法:

    (1).SQL>select * from cz group by c1,c10,c20 having count(*) >1;

    1 SQL>select * from cz group by c1,c10,c20 having count(*) >1;
    2 
    3 C1 C10 C20   
    4 -----------------------   
    5 1 2 dsf   
    6 2 3 che   
    7 3 4 dff 

    (2).SQL>select distinct * from cz;

    1 SQL>select distinct * from cz;
    2 
    3 C1 C10 C20   
    4 -----------------------   
    5 1 2 dsf   
    6 2 3 che   
    7 3 4 dff 

    (3).SQL>select * from cz a where rowid=(select max(rowid) from cz where c1=a.c1 and c10=a.c10 and c20=a.c20);

    1 SQL>select * from cz a where rowid=(select max(rowid) from cz where c1=a.c1 and c10=a.c10 and c20=a.c20);
    2 
    3 C1 C10 C20   
    4 -----------------------   
    5 1 2 dsf   
    6 2 3 che   
    7 3 4 dff 

    2.删除重复记录的几种方法:

    (1).适用于有大量重复记录的情况(在C1,C10和C20列上建有索引的时候,用以下语句效率会很高):

     1 SQL>DELETE FROM cz
     2       WHERE (c1, c10, c20) IN (  SELECT c1, c10, c20
     3                                    FROM cz
     4                                GROUP BY c1, c10, c20
     5                                  HAVING COUNT (*) > 1)
     6             AND ROWID NOT IN (  SELECT MIN (ROWID)
     7                                   FROM cz
     8                               GROUP BY c1, c10, c20
     9                                 HAVING COUNT (*) > 1);
    10 
    11 SQL>DELETE fron cz
    12  WHERE ROWID NOT IN (  SELECT MIN (ROWID)
    13                          FROM cz
    14                      GROUP BY c1, c10, c20);

    (2).适用于有少量重复记录的情况(注意,对于有大量重复记录的情况,用以下语句效率会很低):

     1 SQL>DELETE FROM cz a
     2       WHERE a.ROWID !=
     3                (SELECT MAX (ROWID)
     4                   FROM cz b
     5                  WHERE a.c1 = b.c1 AND a.c10 = b.c10 AND a.c20 = b.c20);
     6 
     7 SQL>DELETE FROM cz a
     8       WHERE a.ROWID <
     9                (SELECT MAX (ROWID)
    10                   FROM cz b
    11                  WHERE a.c1 = b.c1 AND a.c10 = b.c10 AND a.c20 = b.c20);
    12 
    13 SQL>DELETE FROM cz a
    14       WHERE ROWID < (SELECT MAX (ROWID)
    15                        FROM cz
    16                       WHERE c1 = a.c1 AND c10 = a.c10 AND c20 = a.c20);

    (3).适用于有少量重复记录的情况(临时表法):

    1 SQL>create table test as select distinct * from cz; (建一个临时表test用来存放重复的记录)
    2 
    3 SQL>truncate table cz; (清空cz表的数据,但保留cz表的结构)
    4 
    5 SQL>insert into cz select * from test; (再将临时表test里的内容反插回来)

    (4).适用于有大量重复记录的情况(Exception into 子句法):

    采用alter table 命令中的 Exception into 子句也可以确定出库表中重复的记录。这种方法稍微麻烦一些,为了使用“excepeion into ”子句,必须首先创建 EXCEPTIONS 表。创建该表的 SQL 脚本文件为 utlexcpt.sql 。对于win2000系统和 UNIX 系统, Oracle 存放该文件的位置稍有不同,在win2000系统下,该脚本文件存放在$ORACLE_HOMEOra90 dbmsadmin 目录下;而对于 UNIX 系统,该脚本文件存放在$ORACLE_HOME/rdbms/admin 目录下。

    具体步骤如下:

     1 SQL>@?/rdbms/admin/utlexcpt.sql
     2     Table created.
     3     SQL>desc exceptions
     4     Name Null? Type
     5     ----------------------------------------- -------- --------------
     6     ROW_ID ROWID
     7     OWNER VARCHAR2(30)
     8     TABLE_NAME VARCHAR2(30)
     9     CONSTRAINT VARCHAR2(30)
    10     SQL>alter table cz add constraint cz_unique unique(c1,c10,c20) exceptions into exceptions;
    11     *
    12     ERROR at line 1:
    13     ORA-02299: cannot validate (TEST.CZ_UNIQUE) - duplicate keys found
    14     SQL>create table dups as select * from cz where rowid in (select row_id from exceptions);
    15     Table created.
    16     SQL>select * from dups;
    17     C1 C10 C20
    18     ---------- ---------- ---
    19 2 dsf
    20 2 dsf
    21 2 dsf
    22 2 dsf
    23 3 che
    24 2 dsf
    25 2 dsf
    26 2 dsf
    27 2 dsf
    28 3 che
    29 3 che
    30 3 che
    31 3 che
    32 4 dff
    33 4 dff
    34 4 dff
    35 rows selected.
    36     SQL>select row_id from exceptions;
    37     ROW_ID
    38     ---------- ---------- ---
    39     AAAHD/AAIAAAADSAAA
    40     AAAHD/AAIAAAADSAAB
    41     AAAHD/AAIAAAADSAAC
    42     AAAHD/AAIAAAADSAAF
    43     AAAHD/AAIAAAADSAAH
    44     AAAHD/AAIAAAADSAAI
    45     AAAHD/AAIAAAADSAAG
    46     AAAHD/AAIAAAADSAAD
    47     AAAHD/AAIAAAADSAAE
    48     AAAHD/AAIAAAADSAAJ
    49     AAAHD/AAIAAAADSAAK
    50     AAAHD/AAIAAAADSAAL
    51     AAAHD/AAIAAAADSAAM
    52     AAAHD/AAIAAAADSAAN
    53     AAAHD/AAIAAAADSAAO
    54     AAAHD/AAIAAAADSAAP
    55 rows selected.
    56     SQL>delete from cz where rowid in ( select row_id from exceptions);
    57 rows deleted.
    58     SQL>insert into cz select distinct * from dups;
    59 rows created.
    60     SQL>select *from cz;
    61     C1 C10 C20
    62     ---------- ---------- ---
    63 2 dsf
    64 3 che
    65 4 dff
    66 5 err
    67 3 dar
    68 1 wee
    69 2 zxc
    70 rows selected.
    View Code

    从结果里可以看到重复记录已经删除。

    原文链接:http://database.ctocio.com.cn/457/9486457_3.shtml

  • 相关阅读:
    Eclipse的常见使用错误及编译错误
    Android学习笔记之Bundle
    Android牟利之道(二)广告平台的介绍
    Perl dbmopen()函数
    Perl子例程(函数)
    Perl内置操作符
    Perl正则表达式
    Linux之间配置SSH互信(SSH免密码登录)
    思科路由器NAT配置详解(转)
    Windows下查看端口被程序占用的方法
  • 原文地址:https://www.cnblogs.com/kingxiaozi/p/3974749.html
Copyright © 2011-2022 走看看