首先我们需要部署好hadoop集群,

hadoop-3.2.3部署过程

2、配置环境变量

export JAVA_HOME=/opt/env/jdk1.8.0_202
export KE_HOME=/opt/env/kafka-eagle/efak-web-2.1.0
export HADOOP_HOME=/opt/env/hadoop-3.2.3
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
export HADOOP_CLASSPATH=`hadoop classpath`
export YARN_CLASSPATH=`yarn classpath`
export PATH=.:$JAVA_HOME/bin:$PATH:/opt/env/kafka/bin:$HADOOP_HOME/bin

3、直接启动

/opt/env/flink-1.13.6/bin/yarn-session.sh

如果遇到如下错误

java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/exceptions/YarnException

下载jar包放入lib下即可解决

wget https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.8.3-10.0/flink-shaded-hadoop-2-uber-2.8.3-10.0.jar

 

 

最后修改于 2022-05-24 11:53:57
如果觉得我的文章对你有用,请随意赞赏
扫一扫支付
上一篇