flink submit new job提示Internal server error 1.提交jar包到flink web UI上sumbit一直出现错误 Server Response Message: Internal server error. 2.直接去flink/log目录排错 cat flink-zytshijack-standalonesession-0-bogon.log 错误提示找不到类 3.确认jar中的运行类是否正确 使用winRAR工具查看jar包发现scala...
当我试图通过命令行提交作业时,作业提交失败,错误消息如下 org.apache.flink.client.program.ProgramInvocationException: Could not submit job (JobID: f839aefee74aa4483ce8f8fd2e49b69e) .在jobmanager示例中,在作业从部署切换到运行之前,一切正常。在那之后,一旦akkatimeut过期,我会看到下面的stacktrace akka.pa...
<allocations> <queue name="root"> <aclSubmitApps>hadoop</aclSubmitApps> <aclAdministerApps>hadoop</aclAdministerApps> <queue name="queue_hadoop_01"> <maxRunningApps>10</maxRunningApps> <minResources>1024mb,1vcores</minResources> <maxResources>6144mb,6vcores</maxResources> <schedulingPolicy>fai...
然后在提交Flink任务应该就可以了。 例如在文件 fair-scheduler.xml 创建一个queue_hadoop_01的队列: <allocations> <queue name="root"> <aclSubmitApps>hadoop</aclSubmitApps> <aclAdministerApps>hadoop</aclAdministerApps> <queue name="queue_hadoop_01"> <maxRunningApps>10</maxRunningApps> <minResources...
这里的 Dispatcher 是一个接收job,然后指派JobMaster去启动任务的类,我们可以看看它的 类结构,有两个实现。在本地环境下启动的是 MiniDispatcher ,在集群上提交任务时,集群 上启动的是 StandaloneDispatcher 。 1.3 Dispatcher::internalSubmitJob 基类Dispatcher 的submitJob 方法比较简单,代码就不贴了,重点看 Dispatch...
Map<String, String> appMasterEnv = new HashMap<>() 创建用于存放 AM 的环境信息 amContainer.setEnvironment(appMasterEnv) 设置环境信息到 amContainer yarnClient.submitApplication(appContext) 提交应用,其中包含 AM 容器 ShutdownHookUtil.removeShutdownHook 部署成功后,移除 hook 接下来我们重点看一下...
093 ERROR org.apache.flink.runtime.rest.handler.job.JobSubmitHandler - Implementation error: Unhandled exception. akka.pattern.AskTimeoutException: Ask timed out on [Actor[akka://flink/user/dispatcher#1998075247]] after [10000 ms]. Sender[null] sent message of type "org.apache.flink.runtime....
Internal server error. 我们查看 Flink Job Manager 的日志可以看到: image 2020-03-27 14:36:30,150 ERROR org.apache.flink.runtime.webmonitor.handlers.JarRunHandler - Unhandled exception. org.apache.flink.client.program.ProgramInvocationException:The main method caused anerror:No operators defined in...
ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.flink.runtime.rest.util.RestClientException: [Internal server error., <Exception on server side: org.apache.flink.runtime.client.JobSubmissionException: Failed to ...
util.RestClientException: [Internal server error., <Exception on server side: org.apache.flink.runtime.client.JobSubmissionException: Failed to submit job. at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$internalSubmitJob$3(Dispatcher.java:336) at java.util.concurrent.CompletableFuture.uni...