TextBin

New Paste Browse

Singularity> convertFromSource.py -i /eos/cms/store/group/phys_btag/PHM_tagger/test/Data_Zprime_bb_merged/samples.txt  -o /eos/cms/store/group/phys_btag/PHM_tagger/test/elijah/etestConvert_TrainData_DF3 -c TrainData_DF
2022-05-31 01:16:11.430831: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2022-05-31 01:16:13,965:INFO:root: infile = /eos/cms/store/group/phys_btag/PHM_tagger/test/Data_Zprime_bb_merged/samples.txt
2022-05-31 01:16:13,965:INFO:root: outPath = /eos/cms/store/group/phys_btag/PHM_tagger/test/elijah/etestConvert_TrainData_DF3
2022-05-31 01:16:13,965:INFO:root: Start conversion
/afs/cern.ch/user/e/esherida/.local/lib/python3.6/site-packages/numpy/lib/histograms.py:1123: RuntimeWarning: invalid value encountered in true_divide
  hist /= s
2022-05-31 01:16:22,260:INFO:DeepJetCore.DataCollection: creating dir /dev/shm/9195
2022-05-31 01:16:22,386:INFO:root: starting /eos/cms/store/group/phys_btag/PHM_tagger/test/Data_Zprime_bb_merged/ntuple_merged_0.root...
2022-05-31 01:16:22,396:INFO:DeepJetCore.DataCollection: async started
2022-05-31 01:16:22,397:INFO:DeepJetCore.DataCollection: start cp
2022-05-31 01:16:23,264:INFO:DeepJetCore.DataCollection: convertFromSourceFile
reading /dev/shm/9195/9243_tmp_ntuple_merged_0.root
problem in ntuple_merged_0.djctd
Process Process-1:
Traceback (most recent call last):
  File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/usr/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/afs/cern.ch/user/e/esherida/DeepJetCore/DataCollection.py", line 446, in writeData_async
    td.writeFromSourceFile(tmpinput, self.weighterobjects, istraining = not self.istestdata, outname=newpath)
  File "/afs/cern.ch/user/e/esherida/DeepJetCore/TrainData.py", line 108, in writeFromSourceFile
    self.readFromSourceFile(filename, weighterobjects, istraining)
  File "/afs/cern.ch/user/e/esherida/DeepJetCore/TrainData.py", line 84, in readFromSourceFile
    x,y,w = self.convertFromSourceFile(filename, weighterobjects, istraining,  **kwargs)
  File "/afs/cern.ch/user/e/esherida/DeepJetCore/DeepJet/modules/datastructures/TrainData_deepFlavour.py", line 1530, in convertFromSourceFile
    truth = reduceTruth(truth_arrays)
  File "/afs/cern.ch/user/e/esherida/DeepJetCore/DeepJet/modules/datastructures/TrainData_deepFlavour.py", line 1494, in reduceTruth
    return np.vstack((b,bb+gbb,lepb,c+cc+gcc,uds,g)).transpose()
  File "<__array_function__ internals>", line 6, in vstack
TypeError: no implementation found for 'numpy.vstack' on types that implement __array_function__: [<class 'awkward.highlevel.Array'>]
2022-05-31 01:18:15,425:INFO:root: finished /eos/cms/store/group/phys_btag/PHM_tagger/test/Data_Zprime_bb_merged/ntuple_merged_0.root...
2022-05-31 01:18:15,699:INFO:root: starting /eos/cms/store/group/phys_btag/PHM_tagger/test/Data_Zprime_bb_merged/ntuple_merged_1.root...
2022-05-31 01:18:15,706:INFO:root: >>>> collected result 1 of 21
2022-05-31 01:18:15,707:INFO:DeepJetCore.DataCollection: async started
2022-05-31 01:18:15,708:INFO:DeepJetCore.DataCollection: start cp
Traceback (most recent call last):
  File "/afs/cern.ch/user/e/esherida/DeepJetCore/bin/convertFromSource.py", line 130, in <module>
    checkfiles=dofilecheck
  File "/afs/cern.ch/user/e/esherida/DeepJetCore/DataCollection.py", line 555, in convertListOfRootFiles
    dir_check= not self.batch_mode
  File "/afs/cern.ch/user/e/esherida/DeepJetCore/DataCollection.py", line 373, in createDataFromRoot
    self.__writeData_async_andCollect(0, outputDir)
  File "/afs/cern.ch/user/e/esherida/DeepJetCore/DataCollection.py", line 528, in __writeData_async_andCollect
    __collectWriteInfo(r[1][0],r[1][1],r[1][2],outputDir)
  File "/afs/cern.ch/user/e/esherida/DeepJetCore/DataCollection.py", line 464, in __collectWriteInfo
    raise Exception("write not successful, stopping")
Exception: write not successful, stopping
cp: cannot create regular file '/dev/shm/9195/11915_tmp_ntuple_merged_1.root': No such file or directory
Process Process-2:
Traceback (most recent call last):
  File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/usr/lib/python3.6/multiprocessing/process.py", line 93, in run
    self._target(*self._args, **self._kwargs)
  File "/afs/cern.ch/user/e/esherida/DeepJetCore/DataCollection.py", line 435, in writeData_async
    raise Exception("copy to ramdisk not successful for "+sample)
Exception: copy to ramdisk not successful for /eos/cms/store/group/phys_btag/PHM_tagger/test/Data_Zprime_bb_merged/ntuple_merged_1.root
Singularity>

Paste Settings

Paste Title : [Optional]

Paste Folder : [Optional]

Syntax Highlighting : [Optional]

Paste Expiration : [Optional]

Paste Status : [Optional]

Password : [Optional]

Description: [Optional]

Tags: [Optional]

Encrypt Paste (?)

You are currently not logged in, this means you can not edit or delete anything you paste. Sign Up or Login

Paste Settings

Site Languages