zoukankan      html  css  js  c++  java
  • shardingsphere-Proxy 初次使用

    概述

    shardingsphere-proxy 使用代理,什么意思呢,就是我只要发送给代理例如,

    select * from t_order where id = 1;
    

    的查询,而实际 shardingsphere-proxy 执行的分库分表中的 :

    select * from t_order_0 where id = 1;
    select * from t_order_1 where id = 1;
    
    

    然后框架封装结果返回给用户。 分次测试环境 : 数据库(MySQL), 操作系统(Window)

    下载启动

    下载地址 : https://mirror.bit.edu.cn/apache/shardingsphere/4.1.0/apache-shardingsphere-4.1.0-sharding-proxy-bin.tar.gz 下载完以后解压需要注意一下,window 环境不要用 7z 等解压工具(因为里面有些文件的文件名过长,解压软件会截断),window 环境下 cmd ,然后执行 :

      tar zxvf apache-shardingsphere-4.1.0-sharding-proxy-bin.tar.gz
    
    

    然后修改 /config 中的两个文件,我的 config-sharding.yaml 文件修改如下 :

     #
    # Licensed to the Apache Software Foundation (ASF) under one or more
    # contributor license agreements.  See the NOTICE file distributed with
    # this work for additional information regarding copyright ownership.
    # The ASF licenses this file to You under the Apache License, Version 2.0
    # (the "License"); you may not use this file except in compliance with
    # the License.  You may obtain a copy of the License at
    #
    #     http://www.apache.org/licenses/LICENSE-2.0
    #
    # Unless required by applicable law or agreed to in writing, software
    # distributed under the License is distributed on an "AS IS" BASIS,
    # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    # See the License for the specific language governing permissions and
    # limitations under the License.
    #
    
    ######################################################################################################
    # 
    # Here you can configure the rules for the proxy.
    # This example is configuration of sharding rule.
    #   
    # If you want to use sharding, please refer to this file; 
    # if you want to use master-slave, please refer to the config-master_slave.yaml.
    # 
    ######################################################################################################
    #
    #schemaName: sharding_db
    #
    #dataSources:
    #  ds_0:
    #    url: jdbc:postgresql://127.0.0.1:5432/demo_ds_0?serverTimezone=UTC&useSSL=false
    #    username: postgres
    #    password: postgres
    #    connectionTimeoutMilliseconds: 30000
    #    idleTimeoutMilliseconds: 60000
    #    maxLifetimeMilliseconds: 1800000
    #    maxPoolSize: 50
    #  ds_1:
    #    url: jdbc:postgresql://127.0.0.1:5432/demo_ds_1?serverTimezone=UTC&useSSL=false
    #    username: postgres
    #    password: postgres
    #    connectionTimeoutMilliseconds: 30000
    #    idleTimeoutMilliseconds: 60000
    #    maxLifetimeMilliseconds: 1800000
    #    maxPoolSize: 50
    #
    #shardingRule:
    #  tables:
    #    t_order:
    #      actualDataNodes: ds_${0..1}.t_order_${0..1}
    #      tableStrategy:
    #        inline:
    #          shardingColumn: order_id
    #          algorithmExpression: t_order_${order_id % 2}
    #      keyGenerator:
    #        type: SNOWFLAKE
    #        column: order_id
    #    t_order_item:
    #      actualDataNodes: ds_${0..1}.t_order_item_${0..1}
    #      tableStrategy:
    #        inline:
    #          shardingColumn: order_id
    #          algorithmExpression: t_order_item_${order_id % 2}
    #      keyGenerator:
    #        type: SNOWFLAKE
    #        column: order_item_id
    #  bindingTables:
    #    - t_order,t_order_item
    #  defaultDatabaseStrategy:
    #    inline:
    #      shardingColumn: user_id
    #      algorithmExpression: ds_${user_id % 2}
    #  defaultTableStrategy:
    #    none:
    
    ######################################################################################################
    #
    # If you want to connect to MySQL, you should manually copy MySQL driver to lib directory.
    #
    ######################################################################################################
    
    schemaName: sharding_db
    
    # 分库分表的信息 
    dataSources:
      ds_0:
        url: jdbc:mysql://127.0.0.1:3306/demo_ds_0?serverTimezone=UTC&useSSL=false
        username: root
        password: 12345678
        connectionTimeoutMilliseconds: 30000
        idleTimeoutMilliseconds: 60000
        maxLifetimeMilliseconds: 1800000
        maxPoolSize: 50
      ds_1:
        url: jdbc:mysql://127.0.0.1:3306/demo_ds_1?serverTimezone=UTC&useSSL=false
        username: root
        password: 12345678
        connectionTimeoutMilliseconds: 30000
        idleTimeoutMilliseconds: 60000
        maxLifetimeMilliseconds: 1800000
        maxPoolSize: 50
    
    # 分片规则
    shardingRule:
      tables:
        t_order:
          actualDataNodes: ds_${0..1}.t_order_${0..1}
          tableStrategy:
            inline:
              shardingColumn: order_id
              algorithmExpression: t_order_${order_id % 2}
          keyGenerator:
            type: SNOWFLAKE
            column: order_id
        t_order_item:
          actualDataNodes: ds_${0..1}.t_order_item_${0..1}
          tableStrategy:
            inline:
              shardingColumn: order_id
              algorithmExpression: t_order_item_${order_id % 2}
          keyGenerator:
            type: SNOWFLAKE
            column: order_item_id
      bindingTables:
        - t_order,t_order_item
      defaultDatabaseStrategy:
        inline:
          shardingColumn: user_id
          algorithmExpression: ds_${user_id % 2}
      defaultTableStrategy:
        none:
    
    

    sever.yaml 文件 :

    #
    # Licensed to the Apache Software Foundation (ASF) under one or more
    # contributor license agreements.  See the NOTICE file distributed with
    # this work for additional information regarding copyright ownership.
    # The ASF licenses this file to You under the Apache License, Version 2.0
    # (the "License"); you may not use this file except in compliance with
    # the License.  You may obtain a copy of the License at
    #
    #     http://www.apache.org/licenses/LICENSE-2.0
    #
    # Unless required by applicable law or agreed to in writing, software
    # distributed under the License is distributed on an "AS IS" BASIS,
    # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    # See the License for the specific language governing permissions and
    # limitations under the License.
    #
    
    ######################################################################################################
    # 
    # If you want to configure orchestration, authorization and proxy properties, please refer to this file.
    # 
    ######################################################################################################
    #
    #orchestration:
    #  orchestration_ds:
    #    orchestrationType: registry_center,config_center,distributed_lock_manager
    #    instanceType: zookeeper
    #    serverLists: localhost:2181
    #    namespace: orchestration
    #    props:
    #      overwrite: false
    #      retryIntervalMilliseconds: 500
    #      timeToLiveSeconds: 60
    #      maxRetries: 3
    #      operationTimeoutMilliseconds: 500
    #
    authentication:
      users:
        root:
          password: root
        sharding:
          password: sharding
          authorizedSchemas: sharding_db
    
    props:
      max.connections.size.per.query: 1
      acceptor.size: 16  # The default value is available processors count * 2.
      executor.size: 16  # Infinite by default.
      proxy.frontend.flush.threshold: 128  # The default value is 128.
        # LOCAL: Proxy will run with LOCAL transaction.
        # XA: Proxy will run with XA transaction.
        # BASE: Proxy will run with B.A.S.E transaction.
      proxy.transaction.type: LOCAL
      proxy.opentracing.enabled: false
      proxy.hint.enabled: false
      query.with.cipher.column: true
    
    # 这个属性会打印sql 语句
      sql.show: true
    # 该属性会允许范围查询,默认为 false ,要是我们分库分表是水平切分,可以想得到范围查询会像广播去查每一个表,比较耗性能能。
      allow.range.query.with.inline.sharding: true
    
    

    先在本地数据库建立两个分库,分别是 : demo_ds_0 和 demo_ds_1 ,运行项目,有可能会发现缺少 mysql-connect-java 依赖,去maven 仓库找到jar 包扔到 lib 目录下,然后在 bin 目录启动 start.bat ,启动成功后,

    然后打开本地数据库账号:root ,密码 : root ,端口号 : 3307 ,发现了里面有个 sharding_db,然后执行下面的建表语句 :

    CREATE TABLE `t_order` (
      `order_id` bigint(20) NOT NULL AUTO_INCREMENT,
      `user_id` int(11) NOT NULL,
      `status` varchar(50) COLLATE utf8_bin DEFAULT NULL,
      PRIMARY KEY (`order_id`)
    ) ENGINE=InnoDB AUTO_INCREMENT=279205305122816001 DEFAULT CHARSET=utf8 COLLATE=utf8_bin;
    
    

    然后再打开本地的 demo_ds_0 和 demo_ds_1 你会发现代理帮你创建好表了

    1297993-20200511165236641-524150521.png

    然后再执行 :

    INSERT INTO `t_order` (`order_id`, `user_id`, `status`) VALUES (11, 0, '2');
    INSERT INTO `t_order` (`order_id`, `user_id`, `status`) VALUES (12, 1, '2');
    INSERT INTO `t_order` (`order_id`, `user_id`, `status`) VALUES (13, 0, '2');
    
    

    你会发现对应的 demo_ds_0 和 demo_ds_1 数据库已经有分片好的数据!

    参考资料

    • https://www.cnblogs.com/yeyongjian/p/10107078.html
  • 相关阅读:
    ubuntu16.04解决播放swf视频文件问题
    ubuntu下设置clion是使用clang和clang++
    Linux 下没有conio.h 已解决
    适合最新版docker自定义启动配置
    nginx限制ip并发数
    nginx 403错误
    ubuntu 支持中文
    CentOS 5 上使用yum同时安装32位和64位包的解决方法
    rhel yum报错
    因为swap分区无法启动
  • 原文地址:https://www.cnblogs.com/Benjious/p/12870176.html
Copyright © 2011-2022 走看看