系统环境 Docker > centos7.5 此镜像已经安装了jdk1.8和maven3.6.0
如果你想知道这个基础镜像的具体情况, 参考此文: https://www.cnblogs.com/imyjy/p/10100712.html
第一件事, 造一个包含rocketmq的docker容器镜像
运行基础镜像: docker run -itd -p 19876:9876 --name docker <基础镜像id> /bin/bash
查看容器列表: docker ps -a
进入Docker容器: docker exec -it <容器id> /bin/bash
下载RocketMQ源码
方式1:
安装Git: yum install -y git
查看Git是否安装成功: git --version
下载源码: git clone -b release-4.3.2 https://github.com/apache/rocketmq.git
方式2:
打开rocketmq的github地址: https://github.com/apache/rocketmq
选择合适的版本分支,并下载源码文件
将源码文件拷贝到/home目录
从源码安装RocketMQ
进入源码文件夹: cd rocketmq/
编译安装: mvn -Prelease-all -DskipTests clean install -U
喝个茶, 散个步
安装完成,进入构建文件夹: cd distribution/target/
将rocketmq移动至/usr/local/并重命名: mv ./apache-rocketmq/ /usr/local/rocketmq4.3.2
修改脚本的jvm配置( (默认的内存配置太大了, 容器根本跑不起来)):
vi /usr/local/rocketmq4.3.2/bin/runbroker.sh
vi /usr/local/rocketmq4.3.2/bin/runserver.sh
vi /usr/local/rocketmq4.3.2/bin/tools.sh
退出容器终端: exit
查看容器列表: docker ps -a
保存容器为镜像, 命名为rocketmq: docker commit -m '已安装rocketmq' -a 'yjy' <容器id> rocketmq:1.0
(上面的步骤可能很慢, 并且构建出来的镜像文件非常大, 优化请看此)
查看镜像列表: docker images
现在我们已经拥有了一个包含rocketmq服务的centos系统
第二件事,配置并启动rocketmq集群
查看宿主机ip(后面再集群配置文件中有用到): ifconfig -a (我的宿主机是虚拟机, 所以这里选择 ens33的ip, 反正192.168打头的就没错了)
关闭宿主机的防火墙: service firewalld stop
启动两个容器作为集群(每个容器部署 1个nameserver + 1master + 1slave):
docker run -dit -v /etc/localtime:/etc/localtion:ro --privileged=true -p 9876:9876 -p 10909:10909 -p 10907:10907 -p 10920:10920 -p 10918:10918 -p 11909:11909 -p 11920:11920 --name rocketmq1 <镜像id> /bin/bash
docker run -dit -v /etc/localtime:/etc/localtion:ro --privileged=true -p 9877:9876 -p 10919:10919 -p 10917:10917 -p 10910:10910 -p 10908:10908 -p 11919:11919 -p 11910:11910 --name rocketmq2 <镜像id> /bin/bash
命令解释:
-v /etc/localtime:/etc/localtion:ro: 将宿主机的本地时间挂载到容器中, 保证时间同步, ro表示只读
--privileged=true: 给容器特权, 否则无法访问挂载文件
-p 9876:9876 ...: 绑定宿主机与容器的端口, namesrv会用到1个端口, master和slave分别会用到3个端口(listenPort / haListenPort / fastListenPort)
--name rocketmq1: 指定容器的名字, 好做区分
进入rocketmq1 容器: docker exec -it <容器id> /bin/bash
进入rocketmq配置文件目录: cd /usr/local/rocketmq4.3.2/conf
安装zip工具: yum install zip
安装lrzsz: yum install lrzsz
压缩2m-2s-async配置目录: zip -r ./async.zip ./2m-2s-async/
下载到windows本地修改(比较方便): sz ./async.zip
在本地解压修改4个配置文件(里面的ip根据自己的来):
# Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. brokerClusterName=DefaultCluster brokerName=broker-a brokerId=0 deleteWhen=04 fileReservedTime=48 brokerRole=ASYNC_MASTER flushDiskType=ASYNC_FLUSH # 这里的ip为宿主机的ip namesrvAddr=192.168.25.30:9876;192.168.25.30:9877 brokerIP1=192.168.25.30 brokerIP2=192.168.25.30 listenPort=10909 haListenPort=11909 # fastListenPort = listenPort - 2 autoCreateTopicEnable=true storePathRootDir=/usr/local/rocketmq4.3.2/store-a storePathCommitLog=/usr/local/rocketmq4.3.2/store/commitlog-a storePathConsumeQueue=/usr/local/rocketmq4.3.2/store/consumequeue-a storePathIndex=/usr/local/rocketmq4.3.2/store/index-a storeCheckpoint=/usr/local/rocketmq4.3.2/store/checkpoint-a abortFile=/usr/local/rocketmq4.3.2/store/abort-a
# Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. brokerClusterName=DefaultCluster brokerName=broker-b brokerId=0 deleteWhen=04 fileReservedTime=48 brokerRole=ASYNC_MASTER flushDiskType=ASYNC_FLUSH namesrvAddr=192.168.25.30:9876;192.168.25.30:9877 brokerIP1=192.168.25.30 brokerIP2=192.168.25.30 listenPort=10919 haListenPort=11919 autoCreateTopicEnable=true storePathRootDir=/usr/local/rocketmq4.3.2/store-b storePathCommitLog=/usr/local/rocketmq4.3.2/store/commitlog-b storePathConsumeQueue=/usr/local/rocketmq4.3.2/store/consumequeue-b storePathIndex=/usr/local/rocketmq4.3.2/store/index-b storeCheckpoint=/usr/local/rocketmq4.3.2/store/checkpoint-b abortFile=/usr/local/rocketmq4.3.2/store/abort-b
# Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. brokerClusterName=DefaultCluster brokerName=broker-a brokerId=1 deleteWhen=04 fileReservedTime=48 brokerRole=SLAVE flushDiskType=ASYNC_FLUSH namesrvAddr=192.168.25.30:9876;192.168.25.30:9877 brokerIP1=192.168.25.30 brokerIP2=192.168.25.30 listenPort=10910 haListenPort=11910 autoCreateTopicEnable=true storePathRootDir=/usr/local/rocketmq4.3.2/store-a-s storePathCommitLog=/usr/local/rocketmq4.3.2/store/commitlog-a-s storePathConsumeQueue=/usr/local/rocketmq4.3.2/store/consumequeue-a-s storePathIndex=/usr/local/rocketmq4.3.2/store/index-a-s storeCheckpoint=/usr/local/rocketmq4.3.2/store/checkpoint-a-s abortFile=/usr/local/rocketmq4.3.2/store/abort-a-s
# Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. brokerClusterName=DefaultCluster brokerName=broker-b brokerId=1 deleteWhen=04 fileReservedTime=48 brokerRole=SLAVE flushDiskType=ASYNC_FLUSH namesrvAddr=192.168.25.30:9876;192.168.25.30:9877 brokerIP1=192.168.25.30 brokerIP2=192.168.25.30 listenPort=10920 haListenPort=11920 autoCreateTopicEnable=true storePathRootDir=/usr/local/rocketmq4.3.2/store-b-s storePathCommitLog=/usr/local/rocketmq4.3.2/store/commitlog-b-s storePathConsumeQueue=/usr/local/rocketmq4.3.2/store/consumequeue-b-s storePathIndex=/usr/local/rocketmq4.3.2/store/index-b-s storeCheckpoint=/usr/local/rocketmq4.3.2/store/checkpoint-b-s abortFile=/usr/local/rocketmq4.3.2/store/abort-b-s
回到容器命令行: cd 2m-2s-async
删除原来的4个配置文件: rm -f ./*
上传本地修改过的配置文件: rz
转到bin目录: cd ../../bin
启动 nameserver1: nohup sh mqnamesrv > ../logs/console-namesrv.log &
启动 master1: nohup sh mqbroker -c ../conf/2m-2s-async/broker-a.properties > ../logs/console-master1.log &
启动 slave2: nohup sh mqbroker -c ../conf/2m-2s-async/broker-b-s.properties > ../logs/console-slave2.log &
查看是否启动成功: cat ~/logs/rocketmqlogs/broker.log
回到宿主机: exit
进入rocketmq2容器: docker exec -it <容器id> /bin/bash
到配置文件目录: cd /usr/local/rocketmq4.3.2/conf/2m-2s-async
删除原4个文件: rm -f ./*
上传本地修改过的4个文件: rz (如果提示没有rz命令则先安装: yum install lrzsz)
到bin目录: cd ../../bin/
启动 nameserver2: nohup sh mqnamesrv > ../logs/console-namesrv.log &
启动 master2: nohup sh mqbroker -c ../conf/2m-2s-async/broker-b.properties > ../logs/console-master2.log &
启动 slave1: nohup sh mqbroker -c ../conf/2m-2s-async/broker-a-s.properties > ../logs/console-slave1.log &
查看是否启动成功: cat ~/logs/rocketmqlogs/broker.log
到目前为止我们已经启动了2个nameserver + 2组master + slave
现在回到本地编辑器中, clone rocketMq源码, 使用example模块来测试一下生产者与消费者
生产者:
消费者:
大功告成!
我勒个去, 看看这么简单的步骤, 搞了我3天! 我真蠢