zoukankan      html  css  js  c++  java
  • 【12c】Oracle 12c External Table 外部表

    外部表在Oracle 9i中引入,外部表的特性是对现有SQL*Loader功能的补充,它能够使您访问外部数据源中的数据,就像访问数据库中的表一样。本篇就Oracle 12c中的外部表进行总结和演示,演示环境为Oracle Database 12c Enterprise Edition Release 12.1.0.2.0。

    1 外部表介绍

    外部表是通过create table ... organization external语句创建的,当创建外部表时,需指定如下属性:

    • TYPE:指定外部表的类型,即访问驱动,访问驱动运行在服务器内部的,这点和SQL*Loader不同,有两种可用的类型,分别为:
      • ORACLE_LOADER:默认的访问驱动,它可以将数据从外部表加载到内部表,数据必须来自文本数据文件,但它不能将数据从内部表卸载到外部表;
      • ORACLE_DATAPUMP:该访问驱动可以执行数据的加载和卸载,数据必须来自二进制转储文件,从外部表加载到内部表是通过从二进制转储文件中提取来完成,而从内部表卸载到外部表是通过填充外部表的二进制转储文件来完成的。转储文件一旦创建,可以读取任意次数,但不能被修改,也就是说,不能执行任何DML语句;
    • DEFAULT DIRECTORY:指定所有输入输出文件使用的默认目录,位置是一个目录对象,而不是一个目录路径,在创建外部表前必须先创建目录对象,否则,会出错;
    • ACCESS PARAMETERS:描述外部数据源,并实现指定的外部表的类型,每一种类型的外部表都有自己的访问驱动程序,该驱动程序为该类型的外部表提供唯一的访问参数;
    • LOCATION:指定外部表的数据文件,文件命名方式为directory:file,其中,目录是可选的,若不指定,默认为默认目录。

    2 外部表创建

    外部表的创建可以通过两种访问驱动实现,下面将分别介绍。

    2.1 创建目录对象

    SQL> ho mkdir /home/oracle/ext
    
    
    
    SQL> create directory ext_dir as '/home/oracle/ext';
    
    
    
    Directory created.
    
    SQL> grant read,write on directory ext_dir to alen;
    
    
    
    Grant succeeded.

    2.2 ORACLE_LOAD访问驱动

    2.2.1 手动创建外部表

    创建外部表时如果数据文件不是文本文件,则需要使用preprocessor子句。

    1)创建测试数据

    [oracle@odd ext]$ cat emp.dat
    
    "EMPNO","ENAME","JOB","MGR","HIREDATE","SAL","COMM","DEPTNO"
    
    "7369","SMITH","CLERK","7902","1980/12/17","800.00","","20"
    
    "7499","ALLEN","SALESMAN","7698","1981/2/20","1600.00","300.00","30"
    
    "7521","WARD","SALESMAN","7698","1981/2/22","1250.00","500.00","30"
    
    "7566","JONES","MANAGER","7839","1981/4/2","2975.00","","20"
    
    "7654","MARTIN","SALESMAN","7698","1981/9/28","1250.00","1400.00","30"
    
    "7698","BLAKE","MANAGER","7839","1981/5/1","2850.00","","30"
    
    "7782","CLARK","MANAGER","7839","1981/6/9","2450.00","","10"
    
    "7788","SCOTT","ANALYST","7566","1987/4/19","3000.00","","20"
    
    "7839","KING","PRESIDENT","","1981/11/17","5000.00","","10"
    
    "7844","TURNER","SALESMAN","7698","1981/9/8","1500.00","0.00","30"
    
    "7876","ADAMS","CLERK","7788","1987/5/23","1100.00","","20"
    
    "7900","JAMES","CLERK","7698","1981/12/3","950.00","","30"
    
    "7902","FORD","ANALYST","7566","1981/12/3","3000.00","","20"
    
    "7934","MILLER","CLERK","7782","1982/1/23","1300.00","","10"

    2)创建外部表

    SQL> conn alen/alen@odd
    
    Connected.
    
    SQL> ho cat /home/oracle/ext/emp.sql
    
    create table emp
    
    (
    
    empno number(4),
    
    ename varchar2(10),
    
    job varchar2(9),
    
    mgr number(4),
    
    hiredate date,
    
    sal number(7,2),
    
    comm number(7,2),
    
    deptno number(2)
    
    )
    
    organization external --指定创建的表是外部表
    
    (
    
    type oracle_loader --外部表访问驱动类型
    
    default directory ext_dir --默认目录,需提前创建
    
    access parameters --设置访问参数,注意先后顺序,否则出错
    
    (
    
    records delimited by newline
    
    badfile ext_dir:'emp.bad'
    
    discardfile ext_dir:'emp.dsc'
    
    logfile ext_dir:'emp.log'
    
    field names all files ignore
    
    fields terminated by ',' optionally enclosed by '"' ldrtrim
    
    reject rows with all null fields
    
    (empno,
    
    ename,
    
    job,
    
    mgr,
    
    hiredate char(10) date_format date mask 'yyyy-mm-dd',
    
    sal,
    
    comm,
    
    deptno
    
    ))
    
    location('emp.dat')
    
    )reject limit unlimited;
    
    SQL> @emp.sql
    
    
    
    Table created.
    
    
    
    SQL> set linesize 200
    
    SQL> select * from emp;
    
    
    
    EMPNO ENAME JOB MGR HIREDATE SAL COMM DEPTNO
    
    ---------- ---------- --------- ---------- --------- ---------- ---------- ----------
    
    7369 SMITH CLERK 7902 17-DEC-80 800 20
    
    7499 ALLEN SALESMAN 7698 20-FEB-81 1600 300 30
    
    7521 WARD SALESMAN 7698 22-FEB-81 1250 500 30
    
    7566 JONES MANAGER 7839 02-APR-81 2975 20
    
    7654 MARTIN SALESMAN 7698 28-SEP-81 1250 1400 30
    
    7698 BLAKE MANAGER 7839 01-MAY-81 2850 30
    
    7782 CLARK MANAGER 7839 09-JUN-81 2450 10
    
    7788 SCOTT ANALYST 7566 19-APR-87 3000 20
    
    7839 KING PRESIDENT 17-NOV-81 5000 10
    
    7844 TURNER SALESMAN 7698 08-SEP-81 1500 0 30
    
    7876 ADAMS CLERK 7788 23-MAY-87 1100 20
    
    
    
    EMPNO ENAME JOB MGR HIREDATE SAL COMM DEPTNO
    
    ---------- ---------- --------- ---------- --------- ---------- ---------- ----------
    
    7900 JAMES CLERK 7698 03-DEC-81 950 30
    
    7902 FORD ANALYST 7566 03-DEC-81 3000 20
    
    7934 MILLER CLERK 7782 23-JAN-82 1300 10
    
    
    
    14 rows selected.

    2.2.2 通过sqlldr创建外部表

    外部表可以手动写SQL,也可以使用sqlldr工具生成外部表,下面是具体创建过程。

    1)创建控制文件

    
    [oracle@odd ext]$ cat alen.ctl
    
    load data
    
    field names all files ignore
    
    infile 'emp.dat'
    
    badfile 'emp.bad'
    
    discardfile 'emp.dsc'
    
    into table alen
    
    fields terminated by ',' optionally enclosed by '"'
    
    (empno,
    
    ename,
    
    job,
    
    mgr,
    
    hiredate date 'yyyy-mm-dd',
    
    sal,
    
    comm,
    
    deptno )

    2)sqlldr利用generate_only生成外部表

    [oracle@odd ext]$ sqlldr alen/alen@odd control=alen.ctl external_table=generate_only log=alen.log
    
    
    
    SQL*Loader: Release 12.1.0.2.0 - Production on Wed May 13 22:08:47 2020
    
    
    
    Copyright (c) 1982, 2014, Oracle and/or its affiliates. All rights reserved.
    
    
    
    Path used: External Table

    3)查看日志

    [oracle@odd ext]$ cat alen.log
    
    
    
    SQL*Loader: Release 12.1.0.2.0 - Production on Wed May 13 22:08:47 2020
    
    
    
    Copyright (c) 1982, 2014, Oracle and/or its affiliates. All rights reserved.
    
    
    
    Control File: alen.ctl
    
    Data File: emp.dat
    
    Bad File: emp.bad
    
    Discard File: emp.dsc
    
    (Allow all discards)
    
    
    
    Number to load: ALL
    
    Number to skip: 0
    
    Errors allowed: 50
    
    Continuation: none specified
    
    Path used: External Table
    
    
    
    Table ALEN, loaded from every logical record.
    
    Insert option in effect for this table: INSERT
    
    
    
    Column Name Position Len Term Encl Datatype
    
    ------------------------------ ---------- ----- ---- ---- ---------------------
    
    EMPNO FIRST * , O(") CHARACTER
    
    ENAME NEXT * , O(") CHARACTER
    
    JOB NEXT * , O(") CHARACTER
    
    MGR NEXT * , O(") CHARACTER
    
    HIREDATE NEXT * , O(") DATE 'yyyy-mm-dd'
    
    SAL NEXT * , O(") CHARACTER
    
    COMM NEXT * , O(") CHARACTER
    
    DEPTNO NEXT * , O(") CHARACTER
    
    
    
    
    
    
    
    CREATE TABLE statement for external table:
    
    ------------------------------------------------------------------------
    
    CREATE TABLE "SYS_SQLLDR_X_EXT_ALEN"
    
    (
    
    "EMPNO" NUMBER(4),
    
    "ENAME" VARCHAR2(10),
    
    "JOB" VARCHAR2(9),
    
    "MGR" NUMBER(4),
    
    "HIREDATE" DATE,
    
    "SAL" NUMBER(7,2),
    
    "COMM" NUMBER(7,2),
    
    "DEPTNO" NUMBER(2)
    
    )
    
    ORGANIZATION external
    
    (
    
    TYPE oracle_loader
    
    DEFAULT DIRECTORY EXT_DIR
    
    ACCESS PARAMETERS
    
    (
    
    RECORDS DELIMITED BY NEWLINE CHARACTERSET US7ASCII
    
    BADFILE 'EXT_DIR':'emp.bad'
    
    DISCARDFILE 'EXT_DIR':'emp.dsc'
    
    LOGFILE 'alen.log_xt'
    
    READSIZE 1048576
    
    FIELD NAMES ALL FILES IGNORE
    
    FIELDS TERMINATED BY "," OPTIONALLY ENCLOSED BY '"' LDRTRIM
    
    REJECT ROWS WITH ALL NULL FIELDS
    
    (
    
    "EMPNO" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "ENAME" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "JOB" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "MGR" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "HIREDATE" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"'
    
    DATE_FORMAT DATE MASK 'yyyy-mm-dd',
    
    "SAL" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "COMM" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "DEPTNO" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"'
    
    )
    
    )
    
    location
    
    (
    
    'emp.dat'
    
    )
    
    )REJECT LIMIT UNLIMITED
    
    
    
    
    
    INSERT statements used to load internal tables:
    
    ------------------------------------------------------------------------
    
    INSERT /*+ append */ INTO ALEN
    
    (
    
    EMPNO,
    
    ENAME,
    
    JOB,
    
    MGR,
    
    HIREDATE,
    
    SAL,
    
    COMM,
    
    DEPTNO
    
    )
    
    SELECT
    
    "EMPNO",
    
    "ENAME",
    
    "JOB",
    
    "MGR",
    
    "HIREDATE",
    
    "SAL",
    
    "COMM",
    
    "DEPTNO"
    
    FROM "SYS_SQLLDR_X_EXT_ALEN"
    
    
    
    
    
    statements to cleanup objects created by previous statements:
    
    ------------------------------------------------------------------------
    
    DROP TABLE "SYS_SQLLDR_X_EXT_ALEN"
    
    
    
    
    
    
    
    Run began on Wed May 13 22:08:47 2020
    
    Run ended on Wed May 13 22:08:47 2020
    
    
    
    Elapsed time was: 00:00:00.47
    
    CPU time was: 00:00:00.01

    4)利用上述sql创建外部表SQL

    [oracle@odd ext]$ cat alen.sql
    
    CREATE TABLE alen
    
    (
    
    "EMPNO" NUMBER(4),
    
    "ENAME" VARCHAR2(10),
    
    "JOB" VARCHAR2(9),
    
    "MGR" NUMBER(4),
    
    "HIREDATE" DATE,
    
    "SAL" NUMBER(7,2),
    
    "COMM" NUMBER(7,2),
    
    "DEPTNO" NUMBER(2)
    
    )
    
    ORGANIZATION external
    
    (
    
    TYPE oracle_loader
    
    DEFAULT DIRECTORY EXT_DIR
    
    ACCESS PARAMETERS
    
    (
    
    RECORDS DELIMITED BY NEWLINE CHARACTERSET US7ASCII
    
    BADFILE 'EXT_DIR':'emp.bad'
    
    DISCARDFILE 'EXT_DIR':'emp.dsc'
    
    LOGFILE 'alen.log_xt'
    
    READSIZE 1048576
    
    FIELD NAMES ALL FILES IGNORE
    
    FIELDS TERMINATED BY "," OPTIONALLY ENCLOSED BY '"' LDRTRIM
    
    REJECT ROWS WITH ALL NULL FIELDS
    
    (
    
    "EMPNO" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "ENAME" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "JOB" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "MGR" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "HIREDATE" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"'
    
    DATE_FORMAT DATE MASK 'yyyy-mm-dd',
    
    "SAL" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "COMM" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"',
    
    "DEPTNO" CHAR(255)
    
    TERMINATED BY "," OPTIONALLY ENCLOSED BY '"'
    
    )
    
    )
    
    location
    
    (
    
    'emp.dat'
    
    )
    
    )REJECT LIMIT UNLIMITED

    5)删除原alen表,创建外部表并验证

    SQL> drop table alen;
    
    
    
    Table dropped.
    
    
    
    SQL> @alen.sql
    
    51 ;
    
    
    
    Table created.
    
    
    
    SQL> select count(1) from alen;
    
    
    
    COUNT(1)
    
    ----------
    
    14

    2.3 ORACLE_DATAPUMP访问驱动

    创建外部表,除了使用ORACLE_LOADER驱动之外,还可以使用ORACLE_DATAPUMP,使用ORACLE_DATAPUMP可以实现数据的卸载和加载,通过create table as select 语句,ORACLE_DATAPUMP驱动可以将数据写到一个二进制的dump文件中,但该文件只能通过ORACLE_DATAPUMP访问驱动进行访问,而且,该文件一旦创建,不能被修改,可以被多次读取。

    2.3.1 卸载数据

    1)创建测试数据

    SQL> conn alen/alen@odd
    
    Connected.
    
    SQL> create table dept as select * from scott.dept;
    
    
    
    Table created.
    
    
    
    SQL> select * from dept;
    
    
    
    DEPTNO DNAME LOC
    
    ---------- -------------- -------------
    
    10 ACCOUNTING NEW YORK
    
    20 RESEARCH DALLAS
    
    30 SALES CHICAGO
    
    40 OPERATIONS BOSTON

    2)CTAS方式创建外部表

    SQL> ho cat /home/oracle/ext/dept.sql
    
    create table dept_xt
    
    organization external
    
    (
    
    type oracle_datapump
    
    default directory ext_dir
    
    location('dept_xt.dump')
    
    )
    
    as select * from dept;
    
    
    
    SQL> @/home/oracle/ext/dept.sql
    
    
    
    Table created.

    3)查看表及dump文件

    SQL> select * from dept_xt;
    
    
    
    DEPTNO DNAME LOC
    
    ---------- -------------- -------------
    
    10 ACCOUNTING NEW YORK
    
    20 RESEARCH DALLAS
    
    30 SALES CHICAGO
    
    40 OPERATIONS BOSTON
    
    SQL>ho ls /home/oracle/ext/dept_xt.dump
    
    /home/oracle/ext/dept_xt.dump

    4)修改外部表,出错,即不能进行修改数据

    SQL> update dept_xt set loc='SZ' where deptno=10;
    
    update dept_xt set loc='SZ' where deptno=10
    
    *
    
    ERROR at line 1:
    
    ORA-30657: operation not supported on external organized table

    2.3.2 加载数据

    可以利用上面创建的dump文件创建新的外部表。

    1)利用dump文件创建外部表,location位置可以指定多个dump文件

    SQL> ho cat /home/oracle/ext/alen_xt.sql
    
    create table alen_xt
    
    (
    
    deptno number(2),
    
    dname varchar2(14),
    
    loc varchar2(13)
    
    )
    
    organization external
    
    (
    
    type oracle_datapump
    
    default directory ext_dir
    
    location('dept_xt.dump')
    
    )
    
    ;
    
    SQL> @/home/oracle/ext/alen_xt.sql
    
    
    
    Table created.

    2)查看数据

    SQL> select * from alen_xt;
    
    
    
    DEPTNO DNAME LOC
    
    ---------- -------------- -------------
    
    10 ACCOUNTING NEW YORK
    
    20 RESEARCH DALLAS
    
    30 SALES CHICAGO
    
    40 OPERATIONS BOSTON

    通过上面的介绍和演示,可以看出,外部表在使用上有很大的优势,尤其是在批量处理外部数据的时候。

  • 相关阅读:
    python的多线程问题
    python 调用函数时使用星号 *, **
    python正则中的贪婪与非贪婪
    python中文处理
    Python 模块之 ConfigParser: 用 Python 解析配置文件
    substr使用注意
    [转]互联网后台服务的协议设计
    Java设计模式从精通到入门四 工厂方法模式
    logback中logger详解
    logback实践笔记
  • 原文地址:https://www.cnblogs.com/alen-liu-sz/p/12975536.html
Copyright © 2011-2022 走看看