zoukankan      html  css  js  c++  java
  • Record has Long.MIN_VALUE timestamp (= no timestamp marker). Is the time characteristic set to 'ProcessingTime', or did you forget to call 'DataStream.assignTimestampsAndWatermarks(...)'

    Flink启动报错日志如下:

    Caused by: java.lang.RuntimeException: Record has Long.MIN_VALUE timestamp (= no timestamp marker). Is the time characteristic set to 'ProcessingTime', or did you forget to call 'DataStream.assignTimestampsAndWatermarks(...)'?
    	at org.apache.flink.streaming.api.windowing.assigners.TumblingEventTimeWindows.assignWindows(TumblingEventTimeWindows.java:77)
    	at org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.processElement(WindowOperator.java:293)
    	at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:193)
    	at org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.processElement(StreamTaskNetworkInput.java:179)
    	at org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.emitNext(StreamTaskNetworkInput.java:152)
    	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:67)
    	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:372)
    	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:186)
    	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:575)
    	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:539)
    	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:722)
    	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:547)
    	at java.lang.Thread.run(Thread.java:748)
    

      

    查看代码是使用 ProcessingTime还是 EventTime进行业务处理, 如果是使用的事件时间进行处理的业务,则应该指定相应的事件时间和watermark

    .window(TumblingEventTimeWindows.of(Time.seconds(8))) //添加滚动窗口 ,采用事件时间进行处理
    .window(SlidingProcessingTimeWindows.of(Time.seconds(10),Time.seconds(5))) //添加滑动窗口,采用处理时间进行处理

      

    参考:

    https://blog.csdn.net/u010002184/article/details/115726664

  • 相关阅读:
    python多线程爬取图片二
    python多线程爬取图片实例
    python3的类
    简单的python爬虫实例
    简单的python多线程实例
    webapi 下载Ftp文件并返回流到浏览器完成文件下载
    .net 配置Swagger
    IDEA 发布Api
    MySql 查询表结构信息
    解决js的 Math取正弦值 余弦值不准确的问题
  • 原文地址:https://www.cnblogs.com/-courage/p/14804510.html
Copyright © 2011-2022 走看看