tispark执行任务报错:Failed to start database 'metastore_db'

为提高效率,提问时请提供以下信息,问题描述清晰可优先响应。

  • 【TiDB 版本】:
  • 【问题描述】:
    通过spark shell提交tispark任务,在执行任务时报如下错误,但是我的任务中并没有使用metastore_db中的数据,这个 metastore_db和tidb的表有什么关系呢?并且看着错误是hive表的元数据:

at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Stdoutput Caused by: ERROR XJ040: Failed to start database ‘metastore_db’ with class loader org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@352df548, see the next exception for details.
Stdoutput at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
Stdoutput at org.apache.derby.impl.jdbc.SQLExceptionFactory.wrapArgsForTransportAcrossDRDA(Unknown Source)
Stdoutput … 152 more
Stdoutput Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database /home/teld/tispark/spark-2.3.3-bin-hadoop2.7/bin/metastore_db.
Stdoutput at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
Stdoutput at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
Stdoutput at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown Source)
Stdoutput at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown Source)
Stdoutput at java.security.AccessController.doPrivileged(Native Method)
Stdoutput at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown Source)
Stdoutput at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown Source)

  1. 这两个报错参考下其他案例试试
    (1)Failed to start database ‘metastore_db’ with class loader
    https://stackoverflow.com/questions/37442910/spark-shell-startup-errors/46490557
    image

(2)Another instance of Derby may have already booted the database
https://stackoverflow.com/questions/34465516/caused-by-error-xsdb6-another-instance-of-derby-may-have-already-booted-the-da

image

好的,我们再研究下

有问题请继续反馈,多谢。

此话题已在最后回复的 1 分钟后被自动关闭。不再允许新回复。