技术标签:开发大数据flink 运行Flink报错: The configuration directory was not specified. Please specify the directory containing the configuration file through the ‘FLINK_CONF_DIR’ environment variable. 使用的FLink 1.10以上版... 查看原文 Flink_YARN 上资源申请流程 ...
org.apache.flink.table.catalog.hive.HiveCatalog.createHiveConf // ignore all the static conf file URLs that HiveConf may have set HiveConf.setHiveSiteLocation(null); 结论: Flink 清理了这个静态变量,导致进入 findConfigFile。 MetastoreConf 看样子不支持 HDFS上的 hive-site.xml Flink 如果new了HiveC...
【记录】win启动flink后,运行flink命令报错The configuration directory was not specified. Please specify the directory containing the configuration file through the 'FLINK_CONF_DIR' environment variable 报错如图: 解决:要到flink的bin目录下运行命令
[KYUUBI apache#5315] [Improvement] Propagate HIVE_CONF_DIR on launchi… … 3f12acb pan3793 closed this as completed in ffebc64 Sep 21, 2023 pan3793 pushed a commit that referenced this issue Sep 21, 2023 [KYUUBI #5315][FLINK] Propagate HIVE_CONF_DIR on launching Flink engine … Ve...
export HADOOP_CONF_DIR=/etc/hadoop/conf.cloudera.yarn/ ./bin/yarn-session.sh -n 2 -tm 2000 201705-24 18:39:47,775 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: fs.hdfs.hadoopconf, /etc/hadoop/conf.cloudera.yarn ...
但classLoader.getResource(name); 仍然加载不了,推测是因为 name应当是 "lib/hive-site.xml" 才能正确加载 ? 结论: 需要指定 HIVE_CONF_DIR 解决方案 给Flink 程序传入 HIVE_CONF_DIR,那么具体怎么做的?可以参考 kyuubi 即: -Dcontainerized.master.env.HIVE_CONF_DIR=/etc/hive/conf...