azkban web 啓動報錯

azkban web 啓動報錯信息

2020/05/26 10:50:06.020 +0800 ERROR [AzkabanWebServer] [Azkaban] Could not instantiate UserManager azkaban.user.XmlUserManager
Exception in thread "main" java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
        at azkaban.webapp.AzkabanWebServer.loadUserManager(AzkabanWebServer.java:230)
        at azkaban.webapp.AzkabanWebServer.<init>(AzkabanWebServer.java:181)
        at azkaban.webapp.AzkabanWebServer.main(AzkabanWebServer.java:726)
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at azkaban.webapp.AzkabanWebServer.loadUserManager(AzkabanWebServer.java:226)
        ... 2 more
Caused by: java.lang.IllegalArgumentException: User xml file conf/azkaban-users.xml doesn't exist.
        at azkaban.user.XmlUserManager.parseXMLFile(XmlUserManager.java:87)
        at azkaban.user.XmlUserManager.<init>(XmlUserManager.java:81)
        ... 7 more

問題 : User xml file conf/azkaban-users.xml doesn’t exist.

解決方案 : 有的服務器使用相對路徑就OK ,有的服務器必須使用絕對路徑

[root@Bing-Data-node2 conf]# vim azkaban.properties 
#Azkaban Personalization Settings
azkaban.name=GJR
azkaban.label=Azkaban
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai

#Azkaban UserManager class
user.manager.class=azkaban.user.XmlUserManager
***user.manager.xml.file=/usr/local/azkaban/azkaban-web-2.5.0/conf/azkaban-users.xml
#Loader for projects
executor.global.properties=/usr/local/azkaban/azkaban-web-2.5.0/conf/global.properties*** 
azkaban.project.dir=projects

database.type=mysql
mysql.port=3306
mysql.host=Bing-Data-node2
mysql.database=azkaban
mysql.user=root
mysql.password= qawsEDRF@@
mysql.numconnections=100

# Velocity dev mode
velocity.dev.mode=false

# Azkaban Jetty server properties.
jetty.maxThreads=25
jetty.ssl.port=8443
jetty.port=8081
jetty.keystore=azkaban
"azkaban.properties" 49L, 1140C         


啓動

[root@Bing-Data-node2 bin]# ./azkaban-web-start.sh
Using Hadoop from /usr/local/hadoop-2.8.5
Using Hive from /usr/local/hive
./..
.:/usr/local/jdk1.8.0_251/jre/lib/rt.jar:/usr/local/jdk1.8.0_251/lib/dt.jar:/usr/local/jdk1.8.0_251/lib/tools.jar:./../lib/azkaban-2.5.0.jar:./../lib/commons-collections-3.2.1.jar:./../lib/commons-configuration-1.8.jar:./../lib/commons-dbcp-1.4.jar:./../lib/commons-dbutils-1.5.jar:./../lib/commons-email-1.2.jar:./../lib/commons-fileupload-1.2.1.jar:./../lib/commons-io-2.4.jar:./../lib/commons-jexl-2.1.1.jar:./../lib/commons-lang-2.6.jar:./../lib/commons-logging-1.1.1.jar:./../lib/commons-pool-1.6.jar:./../lib/guava-13.0.1.jar:./../lib/h2-1.3.170.jar:./../lib/httpclient-4.2.1.jar:./../lib/httpcore-4.2.1.jar:./../lib/jackson-core-asl-1.9.5.jar:./../lib/jackson-mapper-asl-1.9.5.jar:./../lib/jetty-6.1.26.jar:./../lib/jetty-util-6.1.26.jar:./../lib/joda-time-2.0.jar:./../lib/jopt-simple-4.3.jar:./../lib/junit-4.8.jar:./../lib/log4j-1.2.16.jar:./../lib/mail-1.4.5.jar:./../lib/mysql-connector-java-5.1.28.jar:./../lib/servlet-api-2.5.jar:./../lib/slf4j-api-1.6.1.jar:./../lib/slf4j-log4j12-1.6.4.jar:./../lib/velocity-1.7.jar:./../lib/velocity-tools-2.0.jar:./../extlib/derby.jar:./../plugins/*/*.jar:/usr/local/hadoop-2.8.5/conf:/usr/local/hadoop-2.8.5/*:/usr/local/hive/conf:/usr/local/hive/lib/*
[root@Bing-Data-node2 bin]# 2020/05/26 11:04:55.518 +0800 ERROR [AzkabanWebServer] [Azkaban] Starting Jetty Azkaban Executor...
2020/05/26 11:04:55.534 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from ./../conf
2020/05/26 11:04:55.534 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file
2020/05/26 11:04:55.541 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up Jetty Https Server with port:8443 and numThreads:25
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/azkaban/azkaban-web-2.5.0/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/hive/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2020/05/26 11:04:55.558 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2020/05/26 11:04:55.578 +0800 INFO [AzkabanWebServer] [Azkaban] Loading user manager class azkaban.user.XmlUserManager
2020/05/26 11:04:55.603 +0800 INFO [XmlUserManager] [Azkaban] Loading user azkaban
2020/05/26 11:04:55.605 +0800 INFO [XmlUserManager] [Azkaban] Loading user metrics
2020/05/26 11:04:55.605 +0800 INFO [XmlUserManager] [Azkaban] Loading user admin
2020/05/26 11:04:55.955 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old logs from execution_logs
2020/05/26 11:04:55.955 +0800 INFO [AzkabanWebServer] [Azkaban] Loading JDBC for project management
2020/05/26 11:04:55.959 +0800 INFO [ProjectManager] [Azkaban] Project version retention is set to 3
2020/05/26 11:04:55.996 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old log files before 2020-03-03T11:04:55.961+08:00
2020/05/26 11:04:55.998 +0800 INFO [ExecutorManager] [Azkaban] Cleaned up 0 log entries.
2020/05/26 11:04:56.024 +0800 INFO [TriggerManager] [Azkaban] TriggerManager loaded.
2020/05/26 11:04:56.024 +0800 INFO [AzkabanWebServer] [Azkaban] Loading built-in checker and action types
2020/05/26 11:04:56.028 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker BasicTimeChecker
2020/05/26 11:04:56.028 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker SlaChecker
2020/05/26 11:04:56.028 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker ExecutionChecker
2020/05/26 11:04:56.028 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action ExecuteFlowAction
2020/05/26 11:04:56.028 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action KillExecutionAction
2020/05/26 11:04:56.028 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action AlertAction
2020/05/26 11:04:56.028 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action CreateTriggerAction
2020/05/26 11:04:56.028 +0800 INFO [AzkabanWebServer] [Azkaban] Loading trigger based scheduler
2020/05/26 11:04:56.030 +0800 INFO [AzkabanWebServer] [Azkaban] Loading plug-in checker and action types
2020/05/26 11:04:56.030 +0800 ERROR [AzkabanWebServer] [Azkaban] plugin path plugins/triggers doesn't exist!
2020/05/26 11:04:56.031 +0800 INFO [AzkabanWebServer] [Azkaban] Setting timezone to Asia/Shanghai
2020/05/26 11:04:56.031 +0800 INFO [AzkabanWebServer] [Azkaban] Registering MBeans...
2020/05/26 11:04:56.038 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered.
2020/05/26 11:04:56.040 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxTriggerManager registered.
2020/05/26 11:04:56.041 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxExecutorManager registered.
2020/05/26 11:04:56.042 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up web resource dir web/
2020/05/26 11:04:56.086 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loading all triggers from db.
2020/05/26 11:04:56.103 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loaded 0 triggers.
2020/05/26 11:04:56.103 +0800 INFO [log] [Azkaban] jetty-6.1.26
2020/05/26 11:04:56.129 +0800 WARN [log] [Azkaban] failed [email protected]:8443: java.io.FileNotFoundException: /usr/local/azkaban/azkaban-web-2.5.0/bin/azkaban (No such file or directory)
2020/05/26 11:04:56.129 +0800 WARN [log] [Azkaban] failed Server@21b2e768: java.io.FileNotFoundException: /usr/local/azkaban/azkaban-web-2.5.0/bin/azkaban (No such file or directory)
2020/05/26 11:04:56.129 +0800 WARN [AzkabanWebServer] [Azkaban] java.io.FileNotFoundException: /usr/local/azkaban/azkaban-web-2.5.0/bin/azkaban (No such file or directory)
/usr/local/azkaban/azkaban-web-2.5.0/bin/azkaban (No such file or directory)

找不到 derby.jar

2020/05/26 13:36:38.782 +0800 INFO [XmlUserManager] [Azkaban] Loading user metrics
2020/05/26 13:36:38.783 +0800 INFO [XmlUserManager] [Azkaban] Loading user admin
Exception in thread "main" java.lang.NoClassDefFoundError: Could not initialize class org.apache.derby.jdbc.AutoloadedDriver40
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at java.sql.DriverManager.isDriverAllowed(DriverManager.java:556)
        at java.sql.DriverManager.isDriverAllowed(DriverManager.java:548)
        at java.sql.DriverManager.getDrivers(DriverManager.java:446)
        at org.apache.commons.dbcp.BasicDataSource.<clinit>(BasicDataSource.java:57)
        at azkaban.database.DataSourceUtils.getMySQLDataSource(DataSourceUtils.java:98)
        at azkaban.database.DataSourceUtils.getDataSource(DataSourceUtils.java:76)
        at azkaban.database.AbstractJdbcLoader.<init>(AbstractJdbcLoader.java:63)
        at azkaban.executor.JdbcExecutorLoader.<init>(JdbcExecutorLoader.java:59)
        at azkaban.webapp.AzkabanWebServer.loadExecutorManager(AzkabanWebServer.java:247)
        at azkaban.webapp.AzkabanWebServer.<init>(AzkabanWebServer.java:185)
        at azkaban.webapp.AzkabanWebServer.main(AzkabanWebServer.java:726)

[root@Bing-Data-node2 bin]# 
[root@Bing-Data-node2 bin]# 

##解決方案 從hive 下的lib中拷貝

[root@Bing-Data-node2 lib]# pwd
/usr/local/hive/lib
[root@Bing-Data-node2 lib]# cp /usr/local/hive/lib/derby-10.10.2.0.jar /usr/local/azkaban/azkaban-web-2.5.0/lib/
[root@Bing-Data-node2 lib]# cp /usr/local/hive/lib/derby-10.10.2.0.jar /usr/local/azkaban/azkaban-executor-2.5.0/lib/
[root@Bing-Data-node2 lib]# 

相對路徑問題 該爲絕對路徑

Exception in thread "main" java.io.FileNotFoundException: conf/global.properties (No such file or directory)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at azkaban.utils.Props.<init>(Props.java:88)
        at azkaban.utils.Props.<init>(Props.java:74)
        at azkaban.execapp.AzkabanExecutorServer.<init>(AzkabanExecutorServer.java:107)
        at azkaban.execapp.AzkabanExecutorServer.main(AzkabanExecutorServer.java:184)

啓動

zkaban.private.properties  azkaban.properties  global.properties
[root@Bing-Data-node2 conf]# pwd
/usr/local/azkaban/azkaban-executor-2.5.0/conf
[root@Bing-Data-node2 conf]# vim azkaban.properties 
#Azkaban
default.timezone.id=Asia/Shanghai

# Azkaban JobTypes Plugins
azkaban.jobtype.plugin.dir=plugins/jobtypes

#Loader for projects
executor.global.properties=/usr/local/azkaban/azkaban-executor-2.5.0/conf/global.properties
azkaban.project.dir=projects

database.type=mysql
mysql.port=3306
mysql.host=192.168.189.192
mysql.database=azkaban
mysql.user=root
mysql.password=qawsEDRF@@
mysql.numconnections=100

# Azkaban Executor settings
executor.maxThreads=50
executor.port=12321
executor.flow.threads=30

~
~
~
~
~
~
~
~
~
"azkaban.properties" 23L, 510C written                                                                                                   
[root@Bing-Data-node2 conf]# 
[root@Bing-Data-node2 conf]# 
[root@Bing-Data-node2 conf]# ls
azkaban.private.properties  azkaban.properties  global.properties
[root@Bing-Data-node2 conf]# 
[root@Bing-Data-node2 conf]# cd ../
[root@Bing-Data-node2 azkaban-executor-2.5.0]# ls
azkaban.version  bin  conf  currentpid  extlib  lib  plugins
[root@Bing-Data-node2 azkaban-executor-2.5.0]# 
[root@Bing-Data-node2 azkaban-executor-2.5.0]# cd b2020/05/26 13:51:47.078 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished

[root@Bing-Data-node2 azkaban-executor-2.5.0]# 
[root@Bing-Data-node2 azkaban-executor-2.5.0]# cd bin/
[root@Bing-Data-node2 bin]# ls
azkaban-access.log  azkaban-executor-shutdown.sh  azkaban-executor-start.sh  azkaban-webserver.log  executions  projects  start-exec.sh  temp
[root@Bing-Data-node2 bin]# 
[root@Bing-Data-node2 bin]# ./azkaban-executor-start.sh 
Using Hadoop from /usr/local/hadoop-2.8.5
Using Hive from /usr/local/hive
./..
.:/usr/local/jdk1.8.0_251/jre/lib/rt.jar:/usr/local/jdk1.8.0_251/lib/dt.jar:/usr/local/jdk1.8.0_251/lib/tools.jar:./../lib/azkaban-2.5.0.jar:./../lib/commons-collections-3.2.1.jar:./../lib/commons-configuration-1.8.jar:./../lib/commons-dbcp-1.4.jar:./../lib/commons-dbutils-1.5.jar:./../lib/commons-email-1.2.jar:./../lib/commons-fileupload-1.2.1.jar:./../lib/commons-io-2.4.jar:./../lib/commons-jexl-2.1.1.jar:./../lib/commons-lang-2.6.jar:./../lib/commons-logging-1.1.1.jar:./../lib/commons-pool-1.6.jar:./../lib/derby-10.10.2.0.jar:./../lib/guava-13.0.1.jar:./../lib/h2-1.3.170.jar:./../lib/httpclient-4.2.1.jar:./../lib/httpcore-4.2.1.jar:./../lib/jackson-core-asl-1.9.5.jar:./../lib/jackson-mapper-asl-1.9.5.jar:./../lib/jetty-6.1.26.jar:./../lib/jetty-util-6.1.26.jar:./../lib/joda-time-2.0.jar:./../lib/jopt-simple-4.3.jar:./../lib/junit-4.8.jar:./../lib/log4j-1.2.16.jar:./../lib/mail-1.4.5.jar:./../lib/mysql-connector-java-5.1.28.jar:./../lib/servlet-api-2.5.jar:./../lib/slf4j-api-1.6.1.jar:./../lib/slf4j-log4j12-1.6.4.jar:./../lib/velocity-1.7.jar:./../lib/velocity-tools-2.0.jar:./../extlib/*.jar:./../plugins/*/*.jar:/usr/local/hadoop-2.8.5/conf:/usr/local/hadoop-2.8.5/*:/usr/local/hive/conf:/usr/local/hive/lib/*
Starting AzkabanExecutorServer on port 12321 ...
[root@Bing-Data-node2 bin]# 2020/05/26 13:52:18.666 +0800 ERROR [AzkabanExecutorServer] [Azkaban] Starting Jetty Azkaban Executor...
2020/05/26 13:52:18.683 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from ./../conf
2020/05/26 13:52:18.684 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban private properties file
2020/05/26 13:52:18.686 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file
2020/05/26 13:52:18.699 +0800 INFO [AzkabanExecutorServer] [Azkaban] Setting timezone to Asia/Shanghai
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/azkaban/azkaban-executor-2.5.0/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/hive/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2020/05/26 13:52:18.716 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2020/05/26 13:52:18.825 +0800 INFO [FlowRunnerManager] [Azkaban] Execution dir retention set to 86400000 ms
2020/05/26 13:52:18.828 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2020/05/26 13:52:18.828 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2020/05/26 13:52:18.828 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old execution dirs
2020/05/26 13:52:18.832 +0800 INFO [AzkabanExecutorServer] [Azkaban] Registering MBeans...
2020/05/26 13:52:18.844 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered.
2020/05/26 13:52:18.846 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxFlowRunnerManager registered.
2020/05/26 13:52:18.846 +0800 INFO [log] [Azkaban] jetty-6.1.26
2020/05/26 13:52:18.881 +0800 INFO [log] [Azkaban] Started [email protected]:12321
2020/05/26 13:52:18.881 +0800 INFO [AzkabanExecutorServer] [Azkaban] Azkaban Executor Server started on port 12321

jps

[root@Bing-Data-node2 bin]# jps
5987 Jps

4617 AzkabanExecutorServer

29011 AzkabanWebServer

9881 AzkabanWebServer
7706 AzkabanWebServer

32414 AzkabanExecutorServer

訪問一下 馬上報錯

[root@Bing-Data-node2 bin]# 2020/05/26 13:54:52.086 +0800 WARN [log] [Azkaban] EXCEPTION 
javax.net.ssl.SSLHandshakeException: Remote host closed connection during handshake
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1009)
        at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1388)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1416)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1400)
        at org.mortbay.jetty.security.SslSocketConnector$SslConnection.run(SslSocketConnector.java:708)
        at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Caused by: java.io.EOFException: SSL peer shut down incorrectly
        at sun.security.ssl.InputRecord.read(InputRecord.java:505)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:990)
        ... 5 more
2020/05/26 13:54:52.174 +0800 WARN [log] [Azkaban] EXCEPTION 
javax.net.ssl.SSLException: Unrecognized SSL message, plaintext connection?
        at sun.security.ssl.InputRecord.handleUnknownRecord(InputRecord.java:710)
        at sun.security.ssl.InputRecord.read(InputRecord.java:527)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:990)
        at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1388)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1416)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1400)
        at org.mortbay.jetty.security.SslSocketConnector$SslConnection.run(SslSocketConnector.java:708)
        at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

解決方案 一定要使用https://ip:8443 進行訪問 因爲配置了安全證書

https://192.168.189.192:8443/index

可以訪問 但是 AZKBAN 長得醜

連接報錯

javax.net.ssl.SSLHandshakeException: Received fatal alert: certificate_unknown
        at sun.security.ssl.Alerts.getSSLException(Alerts.java:198)
        at sun.security.ssl.Alerts.getSSLException(Alerts.java:159)
        at sun.security.ssl.SSLSocketImpl.recvAlert(SSLSocketImpl.java:2041)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1145)
        at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1388)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1416)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1400)
        at org.mortbay.jetty.security.SslSocketConnector$SslConnection.run(SslSocketConnector.java:708)
        at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

以上警告 忽略不計

在這裏插入圖片描述

終於坑完。。。。。。。。。。。

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章