首先我们需要部署好hadoop集群,
hadoop-3.2.3部署过程
2、配置环境变量
export JAVA_HOME=/opt/env/jdk1.8.0_202
export KE_HOME=/opt/env/kafka-eagle/efak-web-2.1.0
export HADOOP_HOME=/opt/env/hadoop-3.2.3
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
export HADOOP_CLASSPATH=`hadoop classpath`
export YARN_CLASSPATH=`yarn classpath`
export PATH=.:$JAVA_HOME/bin:$PATH:/opt/env/kafka/bin:$HADOOP_HOME/bin
3、直接启动
/opt/env/flink-1.13.6/bin/yarn-session.sh
如果遇到如下错误
java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/exceptions/YarnException
下载jar包放入lib下即可解决
wget https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.8.3-10.0/flink-shaded-hadoop-2-uber-2.8.3-10.0.jar
最后修改于 2022-05-24 11:53:57
如果觉得我的文章对你有用,请随意赞赏
扫一扫支付

