zoukankan      html  css  js  c++  java
  • 【一个小发现】VictoriaMetrics中:vmstorage的备份文件,无法给单机版使用

    首先导入一个按天的备份:

    vmrestore-prod \
      -configFilePath="/etc/cos/config.ini" \
      -credsFilePath="/etc/cos/creds.ini" \
      -customS3Endpoint="https://cos.ap-guangzhou.myqcloud.com" \
      -src="s3://xxxxxx/vm-storage/2021-12-27/" \
      -storageDataPath="/var/victoria-metrics/data/2021-12-27/" \
      -httpListenAddr="0.0.0.0:8420" \
      -memory.allowedBytes=2GB \
      -concurrency=10 \
      -maxBytesPerSecond=100MB  
    

    启动vm单机版:

    victoria-metrics-prod \
      -httpListenAddr="0.0.0.0:8428" \
      -memory.allowedBytes=7GB \
      -retentionPeriod=1y \
      -search.logSlowQueryDuration=3s \
      -search.maxConcurrentRequests=500 \
      -search.maxUniqueTimeseries=3000000 \
      -storageDataPath="/var/victoria-metrics/data/2021-12-27/"
    

    启动的时候出现如下错误:

    2021-12-29T02:51:07.296Z        panic   VictoriaMetrics/lib/storage/index_db.go:3055    FATAL: cannot parse row starting with nsPrefix 1 during merge: cannot unmarshal tag from tag->metricIDs row "\x01\x00\x00\x00\x00\x00\x00\x00\x00\x01flag\x01\x16\xc4\xe8'6FU\xec\x16\xc4\xe8'6FV\v\x16\xc4\xe8'6FV\x11\x16\xc4\xe8'6FV?\x16\xc4\xe8'6FVV\x16\xc4\xe8'6FVk\x16\xc4\xe8'6FVl\x16\xc4\xe8'6FVm\x16\xc4\xe8'6FVn\x16\xc4\xe8'6FVo\x16\xc4\xe8'6FVp\x16\xc4\xe8'6FVq\x16\xc4\xe8'6FVr\x16\xc4\xe8'6FVs\x16\xc4\xe8'6FV\xcb\x16\xc4\xe8'6FV\xcc\x16\xc4\xe8'6FV\xcd\x16\xc4\xe8'6FV\xce\x16\xc4\xe8'6FV\xcf\x16\xc4\xe8'6FV\xd0\x16\xc4\xe8'6FV\xd1\x16\xc4\xe8'6FV\xd2\x16\xc4\xe8'6FV\xd3\x16\xc4\xe8'6FV\xd4\x16\xc4\xe8'6FV\xd5\x16\xc4\xe8'6FV\xd6\x16\xc4\xe8'6FV\xd7\x16\xc4\xe8'6FV\xd8\x16\xc4\xe8'6FV\xd9\x16\xc4\xe8'6FV\xda\x16\xc4\xe8'6FW#\x16\xc4\xe8'6FW$\x16\xc4\xe8'6FW%\x16\xc4\xe8'6FW&\x16\xc4\xe8'6FW'\x16\xc4\xe8'6FW(\x16\xc4\xe8'6FW)\x16\xc4\xe8'6FW*\x16\xc4\xe8'6FW+\x16\xc4\xe8'6FW,\x16\xc4\xe8'6FW-\x16\xc4\xe8'6FW.\x16\xc4\xe8'6FW/": cannot unmarshal key: unsupported escaped char: 
    panic: FATAL: cannot parse row starting with nsPrefix 1 during merge: cannot unmarshal tag from tag->metricIDs row "\x01\x00\x00\x00\x00\x00\x00\x00\x00\x01flag\x01\x16\xc4\xe8'6FU\xec\x16\xc4\xe8'6FV\v\x16\xc4\xe8'6FV\x11\x16\xc4\xe8'6FV?\x16\xc4\xe8'6FVV\x16\xc4\xe8'6FVk\x16\xc4\xe8'6FVl\x16\xc4\xe8'6FVm\x16\xc4\xe8'6FVn\x16\xc4\xe8'6FVo\x16\xc4\xe8'6FVp\x16\xc4\xe8'6FVq\x16\xc4\xe8'6FVr\x16\xc4\xe8'6FVs\x16\xc4\xe8'6FV\xcb\x16\xc4\xe8'6FV\xcc\x16\xc4\xe8'6FV\xcd\x16\xc4\xe8'6FV\xce\x16\xc4\xe8'6FV\xcf\x16\xc4\xe8'6FV\xd0\x16\xc4\xe8'6FV\xd1\x16\xc4\xe8'6FV\xd2\x16\xc4\xe8'6FV\xd3\x16\xc4\xe8'6FV\xd4\x16\xc4\xe8'6FV\xd5\x16\xc4\xe8'6FV\xd6\x16\xc4\xe8'6FV\xd7\x16\xc4\xe8'6FV\xd8\x16\xc4\xe8'6FV\xd9\x16\xc4\xe8'6FV\xda\x16\xc4\xe8'6FW#\x16\xc4\xe8'6FW$\x16\xc4\xe8'6FW%\x16\xc4\xe8'6FW&\x16\xc4\xe8'6FW'\x16\xc4\xe8'6FW(\x16\xc4\xe8'6FW)\x16\xc4\xe8'6FW*\x16\xc4\xe8'6FW+\x16\xc4\xe8'6FW,\x16\xc4\xe8'6FW-\x16\xc4\xe8'6FW.\x16\xc4\xe8'6FW/": cannot unmarshal key: unsupported escaped char: 
    
    goroutine 43 [running]:
    github.com/VictoriaMetrics/VictoriaMetrics/lib/logger.logMessage({0xac07e2, 0x42}, {0xc001318c00, 0x3e3}, 0x2)
            github.com/VictoriaMetrics/VictoriaMetrics/lib/logger/logger.go:270 +0x994
    github.com/VictoriaMetrics/VictoriaMetrics/lib/logger.logLevelSkipframes(0x1, {0xac07e2, 0x167}, {0xaef1c1, 0xc0013c3001}, {0xc000a85558, 0x0, 0xc000a85458})
            github.com/VictoriaMetrics/VictoriaMetrics/lib/logger/logger.go:138 +0x1a5
    github.com/VictoriaMetrics/VictoriaMetrics/lib/logger.logLevel(...)
            github.com/VictoriaMetrics/VictoriaMetrics/lib/logger/logger.go:130
    github.com/VictoriaMetrics/VictoriaMetrics/lib/logger.Panicf(...)
            github.com/VictoriaMetrics/VictoriaMetrics/lib/logger/logger.go:126
    github.com/VictoriaMetrics/VictoriaMetrics/lib/storage.mergeTagToMetricIDsRowsInternal({0xc001294000, 0xc000a85628, 0x417de6}, {0xc0013c3000, 0x1e6, 0x2b61}, 0x1)
            github.com/VictoriaMetrics/VictoriaMetrics/lib/storage/index_db.go:3055 +0x61e
    github.com/VictoriaMetrics/VictoriaMetrics/lib/storage.mergeTagToMetricIDsRows({0xc001294000, 0x7f19c521c318, 0xc00099f000}, {0xc0013c3000, 0xc000a857a8, 0x7355e6})
            github.com/VictoriaMetrics/VictoriaMetrics/lib/storage/index_db.go:3011 +0x29
    github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset.(*blockStreamMerger).flushIB(0xc0006c0140, 0xc00126be1a, 0xc000a85d48, 0xc000082680)
            github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset/merge.go:169 +0x2a3
    github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset.(*blockStreamMerger).Merge(0xc0006c0140, 0xc0000a68b8, 0x3, 0x1a0, 0xc94d08)
            github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset/merge.go:134 +0x42a
    github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset.mergeBlockStreams(0xc000a72000, 0xc00008e120, {0xc0000a68b8, 0x3, 0x3}, 0x314, 0xc000053a28, 0x417de6)
            github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset/merge.go:36 +0x10c
    github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset.(*Table).mergeParts(0xc0006a6e00, {0xc0000a67c8, 0x3, 0x3}, 0xc000098f01, 0x0)
            github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset/table.go:934 +0x854
    github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset.(*Table).mergeExistingParts(0xc0006a6e00, 0xc0)
            github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset/table.go:806 +0x118
    github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset.(*Table).partMerger(0xc0006a6e00)
            github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset/table.go:820 +0x6d
    github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset.(*Table).startPartMergers.func1()
            github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset/table.go:786 +0x26
    created by github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset.(*Table).startPartMergers
            github.com/VictoriaMetrics/VictoriaMetrics/lib/mergeset/table.go:785 +0x2c
    

    VM单机版看来和群集版是不太一致的,未来看能不能通过导入导出的方法来互通数据。

  • 相关阅读:
    atitit.nfc 身份证 银行卡 芯片卡 解决方案 attilax总结
    atitit.php 流行框架 前三甲为:Laravel、Phalcon、Symfony2 attilax 总结
    Atitit.执行cmd 命令行 php
    Atitit. 图像处理jpg图片的压缩 清理垃圾图片 java版本
    atitit。企业组织与软件工程的策略 战略 趋势 原则 attilax 大总结
    atitit. 管理哲学 大毁灭 如何防止企业的自我毁灭
    Atitit.java的浏览器插件技术 Applet japplet attilax总结
    Atitit.jquery 版本新特性attilax总结
    Atitit. 软件开发中的管理哲学一个伟大的事业必然是过程导向为主 过程导向 vs 结果导向
    (转)获取手机的IMEI号
  • 原文地址:https://www.cnblogs.com/ahfuzhang/p/15744107.html
Copyright © 2011-2022 走看看