zoukankan      html  css  js  c++  java
  • Windows平台整合SpringBoot+KAFKA_第1部分_环境配置部分

    项目需要,需要整合 SpringBoot+KAFKA

    我调查了一下,发现Linux中,要先装zoomkeeper,再装KAFKA,如  https://blog.csdn.net/zhangcongyi420/article/details/88674491 

    我CA,我的机器搞不动,而且要搞的话,也要搞好几个虚机一起弄个大数据平台环境,太麻烦,正考虑着呢,看到了下面

    https://www.jianshu.com/p/5da86afed228

    不错哦,试试

    下载了zoopkeeper

    apache-zookeeper-3.5.6-bin.tar.gz

    保存到本地

    D:apache-zookeeper-3.5.6

    按照网上的配置说明,我先配置在自己的zoomkeeper中

    dataDir=D:\apache-zookeeper-3.5.6\data

    然后执行 zkServer

    报错

    C:UsersAdministrator>call  "-Dzookeeper.log.dir=D:apache-zookeeper-3.5.6in
    ..logs" "-Dzookeeper.root.logger=INFO,CONSOLE" "-Dzookeeper.log.file=zookeeper-
    Administrator-server-GAOLE.log" "-XX:+HeapDumpOnOutOfMemoryError" "-XX:OnOutOfMe
    moryError=cmd /c taskkill /pid %%p /t /f" -cp "D:apache-zookeeper-3.5.6in..
    buildclasses;D:apache-zookeeper-3.5.6in..uildlib*;D:apache-zookeeper-3
    .5.6in..*;D:apache-zookeeper-3.5.6in..lib*;D:apache-zookeeper-3.5.6
    in..conf" org.apache.zookeeper.server.quorum.QuorumPeerMain "D:apache-zookeep
    er-3.5.6in..confzoo.cfg"
    文件名、目录名或卷标语法不正确。

    上面有个 JAVA_HOME报错引起了我的注意,不管怎么样,估计这个家伙要找JAVA_HOME的,先满足它再说,毕竟我机器上装的开发环境都有自己的JDK,预先装的JDK无所谓给谁用

    设置好JAVA_HOME后,再执行 zkServer ,目测应该是过了;

    2020-01-03 17:10:56,545 [myid:] - INFO  [main:Environment@109] - Server environm
    ent:java.io.tmpdir=C:UsersADMINI~1AppDataLocalTemp
    2020-01-03 17:10:56,547 [myid:] - INFO  [main:Environment@109] - Server environm
    ent:java.compiler=<NA>
    2020-01-03 17:10:56,547 [myid:] - INFO  [main:Environment@109] - Server environm
    ent:os.name=Windows 7
    2020-01-03 17:10:56,548 [myid:] - INFO  [main:Environment@109] - Server environm
    ent:os.arch=amd64
    2020-01-03 17:10:56,548 [myid:] - INFO  [main:Environment@109] - Server environm
    ent:os.version=6.1
    2020-01-03 17:10:56,549 [myid:] - INFO  [main:Environment@109] - Server environm
    ent:user.name=Administrator
    2020-01-03 17:10:56,549 [myid:] - INFO  [main:Environment@109] - Server environm
    ent:user.home=C:UsersAdministrator
    2020-01-03 17:10:56,550 [myid:] - INFO  [main:Environment@109] - Server environm
    ent:user.dir=C:UsersAdministrator
    2020-01-03 17:10:56,550 [myid:] - INFO  [main:Environment@109] - Server environm
    ent:os.memory.free=114MB
    2020-01-03 17:10:56,551 [myid:] - INFO  [main:Environment@109] - Server environm
    ent:os.memory.max=1801MB
    2020-01-03 17:10:56,552 [myid:] - INFO  [main:Environment@109] - Server environm
    ent:os.memory.total=123MB
    2020-01-03 17:10:56,555 [myid:] - INFO  [main:ZooKeeperServer@938] - minSessionT
    imeout set to 4000
    2020-01-03 17:10:56,555 [myid:] - INFO  [main:ZooKeeperServer@947] - maxSessionT
    imeout set to 40000
    2020-01-03 17:10:56,557 [myid:] - INFO  [main:ZooKeeperServer@166] - Created ser
    ver with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir D:
    apache-zookeeper-3.5.6dataversion-2 snapdir D:apache-zookeeper-3.5.6dataversio
    n-2
    2020-01-03 17:10:56,605 [myid:] - INFO  [main:Log@193] - Logging initialized @63
    1ms to org.eclipse.jetty.util.log.Slf4jLog
    2020-01-03 17:10:56,816 [myid:] - WARN  [main:ContextHandler@1588] - o.e.j.s.Ser
    vletContextHandler@53b32d7{/,null,UNAVAILABLE} contextPath ends with /*
    2020-01-03 17:10:56,817 [myid:] - WARN  [main:ContextHandler@1599] - Empty conte
    xtPath
    2020-01-03 17:10:56,834 [myid:] - INFO  [main:Server@370] - jetty-9.4.17.v201904
    18; built: 2019-04-18T19:45:35.259Z; git: aa1c656c315c011c01e7b21aabb04066635b9f
    67; jvm 1.8.0_60-b27
    2020-01-03 17:10:56,900 [myid:] - INFO  [main:DefaultSessionIdManager@365] - Def
    aultSessionIdManager workerName=node0
    2020-01-03 17:10:56,901 [myid:] - INFO  [main:DefaultSessionIdManager@370] - No
    SessionScavenger set, using defaults
    2020-01-03 17:10:56,906 [myid:] - INFO  [main:HouseKeeper@149] - node0 Scavengin
    g every 600000ms
    2020-01-03 17:10:56,922 [myid:] - INFO  [main:ContextHandler@855] - Started o.e.
    j.s.ServletContextHandler@53b32d7{/,null,AVAILABLE}
    2020-01-03 17:10:56,959 [myid:] - INFO  [main:AbstractConnector@292] - Started S
    erverConnector@3dd3bcd{HTTP/1.1,[http/1.1]}{0.0.0.0:8080}
    2020-01-03 17:10:56,960 [myid:] - INFO  [main:Server@410] - Started @996ms
    2020-01-03 17:10:56,960 [myid:] - INFO  [main:JettyAdminServer@112] - Started Ad
    minServer on address 0.0.0.0, port 8080 and command URL /commands
    2020-01-03 17:10:56,973 [myid:] - INFO  [main:ServerCnxnFactory@135] - Using org
    .apache.zookeeper.server.NIOServerCnxnFactory as server connection factory
    2020-01-03 17:10:56,988 [myid:] - INFO  [main:NIOServerCnxnFactory@673] - Config
    uring NIO connection handler with 10s sessionless connection timeout, 1 selector
     thread(s), 8 worker threads, and 64 kB direct buffers.
    2020-01-03 17:10:56,992 [myid:] - INFO  [main:NIOServerCnxnFactory@686] - bindin
    g to port 0.0.0.0/0.0.0.0:2181
    2020-01-03 17:10:57,012 [myid:] - INFO  [main:ZKDatabase@117] - zookeeper.snapsh
    otSizeFactor = 0.33
    2020-01-03 17:10:57,017 [myid:] - INFO  [main:FileTxnSnapLog@384] - Snapshotting
    : 0x0 to D:apache-zookeeper-3.5.6dataversion-2snapshot.0
    2020-01-03 17:10:57,036 [myid:] - INFO  [main:FileTxnSnapLog@384] - Snapshotting
    : 0x0 to D:apache-zookeeper-3.5.6dataversion-2snapshot.0
    2020-01-03 17:10:57,058 [myid:] - INFO  [main:ContainerManager@64] - Using check
    IntervalMs=60000 maxPerMinute=10000

    周末休息,暂停更新;

    周一过来,接着搞KAFKA

    按照此文描述,开始去下载一个kafka_2.12-2.4.0

    然后修改配置文件,老习惯,先备份,备份之后开始修改 server.properties 

    按照网上的说明,操作成功;启动kafka,一切正常;

     with path version 1 (kafka.coordinator.transaction.ProducerIdManager)
    [2020-01-06 10:49:10,027] INFO [TransactionCoordinator id=0] Starting up. (kafka
    .coordinator.transaction.TransactionCoordinator)
    [2020-01-06 10:49:10,031] INFO [Transaction Marker Channel Manager 0]: Starting
    (kafka.coordinator.transaction.TransactionMarkerChannelManager)
    [2020-01-06 10:49:10,032] INFO [TransactionCoordinator id=0] Startup complete. (
    kafka.coordinator.transaction.TransactionCoordinator)
    [2020-01-06 10:49:10,086] INFO [ExpirationReaper-0-AlterAcls]: Starting (kafka.s
    erver.DelayedOperationPurgatory$ExpiredOperationReaper)
    [2020-01-06 10:49:10,172] INFO [/config/changes-event-process-thread]: Starting
    (kafka.common.ZkNodeChangeNotificationListener$ChangeEventProcessThread)
    [2020-01-06 10:49:10,265] INFO [SocketServer brokerId=0] Started data-plane proc
    essors for 1 acceptors (kafka.network.SocketServer)
    [2020-01-06 10:49:10,280] INFO Kafka version: 2.4.0 (org.apache.kafka.common.uti
    ls.AppInfoParser)
    [2020-01-06 10:49:10,281] INFO Kafka commitId: 77a89fcf8d7fa018 (org.apache.kafk
    a.common.utils.AppInfoParser)
    [2020-01-06 10:49:10,282] INFO Kafka startTimeMs: 1578278950272 (org.apache.kafk
    a.common.utils.AppInfoParser)
    [2020-01-06 10:49:10,286] INFO [KafkaServer id=0] started (kafka.server.KafkaSer
    ver)

    注意:不要关了这个窗口,启用Kafka前请确保ZooKeeper实例已经准备好并开始运行

    按照文章介绍,依次设定topic,创建生产者、消费者,测试

    测试成功,完成kafka的安装及配置;

  • 相关阅读:
    Maven 集成Tomcat插件
    dubbo 序列化 问题 属性值 丢失 ArrayList 解决
    docker 中安装 FastDFS 总结
    docker 从容器中拷文件到宿主机器中
    db2 相关命令
    Webphere WAS 启动
    CKEDITOR 4.6.X 版本 插件 弹出对话框 Dialog中 表格 Table 自定义样式Style 问题
    SpringMVC JSONP JSON支持
    CKEDITOR 3.4.2中 按钮事件中 动态改变图标和title 获取按钮
    git回退到远程某个版本
  • 原文地址:https://www.cnblogs.com/alexgl2008/p/12145712.html
Copyright © 2011-2022 走看看