zoukankan      html  css  js  c++  java
  • Record has Long.MIN_VALUE timestamp (= no timestamp marker). Is the time characteristic set to 'ProcessingTime', or did you forget to call 'DataStream.assignTimestampsAndWatermarks(...)'

    Flink启动报错日志如下:

    Caused by: java.lang.RuntimeException: Record has Long.MIN_VALUE timestamp (= no timestamp marker). Is the time characteristic set to 'ProcessingTime', or did you forget to call 'DataStream.assignTimestampsAndWatermarks(...)'?
    	at org.apache.flink.streaming.api.windowing.assigners.TumblingEventTimeWindows.assignWindows(TumblingEventTimeWindows.java:77)
    	at org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.processElement(WindowOperator.java:293)
    	at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:193)
    	at org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.processElement(StreamTaskNetworkInput.java:179)
    	at org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.emitNext(StreamTaskNetworkInput.java:152)
    	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:67)
    	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:372)
    	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:186)
    	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:575)
    	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:539)
    	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:722)
    	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:547)
    	at java.lang.Thread.run(Thread.java:748)
    

      

    查看代码是使用 ProcessingTime还是 EventTime进行业务处理, 如果是使用的事件时间进行处理的业务,则应该指定相应的事件时间和watermark

    .window(TumblingEventTimeWindows.of(Time.seconds(8))) //添加滚动窗口 ,采用事件时间进行处理
    .window(SlidingProcessingTimeWindows.of(Time.seconds(10),Time.seconds(5))) //添加滑动窗口,采用处理时间进行处理

      

    参考:

    https://blog.csdn.net/u010002184/article/details/115726664

  • 相关阅读:
    html5 保存图片到服务器本地
    html5 canvas分层
    webstorm配置scss自动编译路径
    微信开发测试号配置
    html5手机网站需要加的那些meta/link标签,html5 meta全解
    css去掉iPhone、iPad默认按钮样式
    如何激活webstorm 11
    min-height在安卓下不起作用
    基于字符串模式的路由路径的一些示例。
    nodeJS搭建本地服务器
  • 原文地址:https://www.cnblogs.com/-courage/p/14804510.html
Copyright © 2011-2022 走看看