I run the same code with the same data of last week. Last week is OK. But now has the following errors:
2018-09-19 05:55:58 PST2018-09-19 12:55:58.566976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1423] Adding visible gpu devices: 0
2018-09-19 05:55:58 PST2018-09-19 12:55:58.567170: E tensorflow/core/common_runtime/direct_session.cc:167] **ternal: cudaGetDevice() failed. Status: CUDA driver version is insufficient for CUDA runtime version
2018-09-19 05:55:58 PSTTraceback (most recent call last):
2018-09-19 05:55:58 PSTFile "train.py", line 170, in
2018-09-19 05:55:58 PSTmain(sys.argv)
2018-09-19 05:55:58 PSTFile "train.py", line 159, in main
2018-09-19 05:55:58 PSTtrain(dataset_train, dataset_val, FLAGS.weights, FLAGS.caffemodel)
2018-09-19 05:55:58 PSTFile "train.py", line 75, in train
2018-09-19 05:55:58 PSTsess = tf.Session(config=tf.ConfigProto(log_device_placement=FLAGS.log_device_placement))
2018-09-19 05:55:58 PSTFile "/usr/local/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1509, in init
2018-09-19 05:55:58 PSTsuper(Session, self).init(target, graph, config=config)
2018-09-19 05:55:58 PSTFile "/usr/local/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 638, in init
2018-09-19 05:55:58 PSTself.session = tfsession.TF_NewDeprecatedSession(opts, status)
2018-09-19 05:55:58 PSTFile "/usr/local/lib/python3.6/site-packages/tensorflow/python/framework/errors_impl.py", line 516, in exit
2018-09-19 05:55:58 PSTc_api.TF_GetCode(self.status.status))
2018-09-19 05:55:58 PSTtensorflow.python.framework.errors_impl.InternalError: Failed to create session.
