2023-10-05 17:37:58.836886: <info> Sim Elapsed time: 00:00:02.000; GPS TOW=475202
2023-10-05 17:37:59.836886: <info> Sim Elapsed time: 00:00:03.000; GPS TOW=475203
2023-10-05 17:38:00.836887: <info> Sim Elapsed time: 00:00:04.000; GPS TOW=475204
2023-10-05 17:38:01.836934: <info> Sim Elapsed time: 00:00:05.000; GPS TOW=475205
2023-10-05 17:38:02.836923: <info> Sim Elapsed time: 00:00:06.000; GPS TOW=475206
2023-10-05 17:38:03.836929: <info> Sim Elapsed time: 00:00:07.000; GPS TOW=475207
2023-10-05 17:38:04.837288: <info> Sim Elapsed time: 00:00:08.000; GPS TOW=475208
2023-10-05 17:38:05.841617: <info> Sim Elapsed time: 00:00:09.000; GPS TOW=475209
2023-10-05 17:38:06.836900: <info> Sim Elapsed time: 00:00:10.000; GPS TOW=475210
2023-10-05 17:38:07.836903: <info> Sim Elapsed time: 00:00:11.000; GPS TOW=475211
2023-10-05 17:38:08.836895: <info> Sim Elapsed time: 00:00:12.000; GPS TOW=475212
2023-10-05 17:38:09.836909: <info> Sim Elapsed time: 00:00:13.000; GPS TOW=475213
2023-10-05 17:38:10.836902: <info> Sim Elapsed time: 00:00:14.000; GPS TOW=475214
2023-10-05 17:38:11.836897: <info> Sim Elapsed time: 00:00:15.000; GPS TOW=475215
2023-10-05 17:38:12.836881: <info> Sim Elapsed time: 00:00:16.000; GPS TOW=475216
2023-10-05 17:38:13.836891: <info> Sim Elapsed time: 00:00:17.000; GPS TOW=475217
2023-10-05 17:38:14.836872: <info> Sim Elapsed time: 00:00:18.000; GPS TOW=475218
2023-10-05 17:38:15.846824: <info> Sim Elapsed time: 00:00:19.000; GPS TOW=475219
2023-10-05 17:38:16.836876: <info> Sim Elapsed time: 00:00:20.000; GPS TOW=475220
2023-10-05 17:38:17.836921: <info> Sim Elapsed time: 00:00:21.000; GPS TOW=475221
2023-10-05 17:38:18.836916: <info> Sim Elapsed time: 00:00:22.000; GPS TOW=475222
2023-10-05 17:38:19.836918: <info> Sim Elapsed time: 00:00:23.000; GPS TOW=475223
2023-10-05 17:38:20.836904: <info> Sim Elapsed time: 00:00:24.000; GPS TOW=475224
2023-10-05 17:38:21.836911: <info> Sim Elapsed time: 00:00:25.000; GPS TOW=475225
2023-10-05 17:38:22.836902: <info> Sim Elapsed time: 00:00:26.000; GPS TOW=475226
2023-10-05 17:38:23.836894: <info> Sim Elapsed time: 00:00:27.000; GPS TOW=475227
2023-10-05 17:38:24.836878: <info> Sim Elapsed time: 00:00:28.000; GPS TOW=475228
2023-10-05 17:38:25.846812: <info> Sim Elapsed time: 00:00:29.000; GPS TOW=475229
2023-10-05 17:38:26.836887: <info> Sim Elapsed time: 00:00:30.000; GPS TOW=475230
2023-10-05 17:38:27.836887: <info> Sim Elapsed time: 00:00:31.000; GPS TOW=475231
2023-10-05 17:38:28.836884: <info> Sim Elapsed time: 00:00:32.000; GPS TOW=475232
2023-10-05 17:38:29.836881: <info> Sim Elapsed time: 00:00:33.000; GPS TOW=475233
2023-10-05 17:38:30.836875: <info> Sim Elapsed time: 00:00:34.000; GPS TOW=475234
2023-10-05 17:38:31.836865: <info> Sim Elapsed time: 00:00:35.000; GPS TOW=475235
2023-10-05 17:38:32.836862: <info> Sim Elapsed time: 00:00:36.000; GPS TOW=475236
2023-10-05 17:38:33.836860: <info> Sim Elapsed time: 00:00:37.000; GPS TOW=475237
2023-10-05 17:38:34.836906: <info> Sim Elapsed time: 00:00:38.000; GPS TOW=475238
2023-10-05 17:38:35.847135: <info> Sim Elapsed time: 00:00:39.000; GPS TOW=475239
2023-10-05 17:38:36.836890: <info> Sim Elapsed time: 00:00:40.000; GPS TOW=475240
2023-10-05 17:38:37.836902: <info> Sim Elapsed time: 00:00:41.000; GPS TOW=475241
2023-10-05 17:38:38.836887: <info> Sim Elapsed time: 00:00:42.000; GPS TOW=475242
2023-10-05 17:38:39.836899: <info> Sim Elapsed time: 00:00:43.000; GPS TOW=475243
2023-10-05 17:38:40.836871: <info> Sim Elapsed time: 00:00:44.000; GPS TOW=475244
2023-10-05 17:38:41.836873: <info> Sim Elapsed time: 00:00:45.000; GPS TOW=475245
2023-10-05 17:38:42.836877: <info> Sim Elapsed time: 00:00:46.000; GPS TOW=475246
2023-10-05 17:38:43.836868: <info> Sim Elapsed time: 00:00:47.000; GPS TOW=475247
2023-10-05 17:38:44.836862: <info> Sim Elapsed time: 00:00:48.000; GPS TOW=475248
2023-10-05 17:38:45.847341: <info> Sim Elapsed time: 00:00:49.000; GPS TOW=475249
2023-10-05 17:38:46.836856: <info> Sim Elapsed time: 00:00:50.000; GPS TOW=475250
2023-10-05 17:38:47.836858: <info> Sim Elapsed time: 00:00:51.000; GPS TOW=475251
2023-10-05 17:38:48.836842: <info> Sim Elapsed time: 00:00:52.000; GPS TOW=475252
2023-10-05 17:38:49.836845: <info> Sim Elapsed time: 00:00:53.000; GPS TOW=475253
2023-10-05 17:38:50.836837: <info> Sim Elapsed time: 00:00:54.000; GPS TOW=475254
2023-10-05 17:38:51.836892: <info> Sim Elapsed time: 00:00:55.000; GPS TOW=475255
2023-10-05 17:38:52.836889: <info> Sim Elapsed time: 00:00:56.000; GPS TOW=475256
2023-10-05 17:38:53.836883: <info> Sim Elapsed time: 00:00:57.000; GPS TOW=475257
2023-10-05 17:38:54.836860: <info> Sim Elapsed time: 00:00:58.000; GPS TOW=475258
2023-10-05 17:38:55.847851: <info> Sim Elapsed time: 00:00:59.000; GPS TOW=475259
2023-10-05 17:38:56.836855: <info> Sim Elapsed time: 00:01:00.000; GPS TOW=475260
2023-10-05 17:38:57.836856: <info> Sim Elapsed time: 00:01:01.000; GPS TOW=475261
2023-10-05 17:38:58.836857: <info> Sim Elapsed time: 00:01:02.000; GPS TOW=475262
2023-10-05 17:38:59.836851: <info> Sim Elapsed time: 00:01:03.000; GPS TOW=475263
2023-10-05 17:39:00.836852: <info> Sim Elapsed time: 00:01:04.000; GPS TOW=475264
2023-10-05 17:39:01.836850: <info> Sim Elapsed time: 00:01:05.000; GPS TOW=475265
2023-10-05 17:39:02.836833: <info> Sim Elapsed time: 00:01:06.000; GPS TOW=475266
2023-10-05 17:39:03.836839: <info> Sim Elapsed time: 00:01:07.000; GPS TOW=475267
2023-10-05 17:39:04.216582: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:04.216610: <error> CUDA RAND ERROR Value: 201
2023-10-05 17:39:04.216619: <warning> Advanced Jammers: Sample Block was not pushed during normal operation
2023-10-05 17:39:04.216621: <warning> Advanced Jammers: ModulationOrder was not pushed during normal operation
2023-10-05 17:39:04.221336: <info> Update current computer time (UTC):Thu Oct 5 22:39:04 2023 GMT
2023-10-05 17:39:04.221513: <info> Stopping UHD Streamer
2023-10-05 17:39:04.221523: <info>   A) Stop Streaming Thread
2023-10-05 17:39:04.221526: <info> UHD ST-Thread: Stop!
2023-10-05 17:39:04.221529: <info>     A) Stop UHD Async Messaage Receiving thread
2023-10-05 17:39:04.288429: <info> Underrun Count       = 0
2023-10-05 17:39:04.288438: <info> Sequence error Count = 0
2023-10-05 17:39:04.288440: <info> Late Packet Count    = 0
2023-10-05 17:39:04.288444: <info> Stopping UHD Processor's Thread Completed
2023-10-05 17:39:04.288478: <info>     B) Signal streaming to stop.
2023-10-05 17:39:04.288486: <info>   B) Stopping GPIO Thread
2023-10-05 17:39:04.289323: <info> Empty GPIO Cmd queue
2023-10-05 17:39:04.289333: <info> Empty GPIO Cmd queue - DONE
2023-10-05 17:39:04.289354: <info>   C) Stopping Gain Thread
2023-10-05 17:39:04.289946: <info> Empty GAIN Cmd queue
2023-10-05 17:39:04.289955: <info> Empty GAIN Cmd queue - DONE
2023-10-05 17:39:04.290010: <info>     Waiting for streaming to stop.
2023-10-05 17:39:04.290032: <info>     C) Send end of burst to UHD
2023-10-05 17:39:04.390115: <info>     D) Reset packet buffers
2023-10-05 17:39:04.390124: <info>     E) set X300 Device in Power Save Mode
2023-10-05 17:39:04.390174: <info> Streamer stopping completed
2023-10-05 17:39:04.490439: <info>     Ending thread.
2023-10-05 17:39:04.490472: <info>   D) Stopping Streamer Thread
2023-10-05 17:39:04.491129: <info>   E) Stopping Radio Time Thread
2023-10-05 17:39:05.410718: <info> Reseting Modulation Order Queues
2023-10-05 17:39:05.410990: <info> Reseting 1 Sample Block Pipelines
2023-10-05 17:39:05.417308: <info> SimulatorEngine: Unset configuration
2023-10-05 17:39:06.397463: <info>   Release Spectrum allocations
2023-10-05 17:39:06.397549: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.397556: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.397562: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.397567: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.397928: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.397938: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.397943: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.397953: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.397969: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.397979: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.397984: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.397991: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398000: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398005: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398010: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398017: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398022: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398030: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398070: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398075: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398084: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398090: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398098: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398103: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398123: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398135: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398141: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398152: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398165: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398173: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398180: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398184: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398191: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398198: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398206: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398216: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398340: <info> Releasing 0 samples blocks from Host Memory
2023-10-05 17:39:06.398346: <info> Releasing 0 samples blocks from Host Memory
2023-10-05 17:39:06.398353: <info> Releasing 101 GPU IQ Float buffers for advanced jammers
2023-10-05 17:39:06.398360: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398367: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398371: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398377: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398383: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398391: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398404: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398409: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398413: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398428: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398432: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398438: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398442: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398448: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398457: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398460: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398467: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398478: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398485: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398489: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398497: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398502: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398507: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398514: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398518: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398523: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398529: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398539: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398543: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398551: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398556: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398571: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398576: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398582: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398595: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398601: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398607: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398614: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398620: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398626: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398631: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398638: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398648: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398653: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398659: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398665: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398670: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398676: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398683: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398694: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398699: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398709: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398715: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398727: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398738: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398743: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398754: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398758: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398763: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398775: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398780: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398789: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398800: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398805: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398810: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398819: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398827: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398832: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398837: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398845: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398851: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398859: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398865: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398870: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398875: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398883: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398887: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398900: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398907: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398911: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398918: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398924: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398930: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398936: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398946: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398952: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398957: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398962: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398968: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398975: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398981: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398986: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.398997: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399003: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399008: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399015: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399021: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399027: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399038: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399043: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399054: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399061: <info> Releasing GPU IQ Int buffer of RF Output #2 for advanced jammers
2023-10-05 17:39:06.399068: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399073: <info> Releaseing jammer buffers
2023-10-05 17:39:06.399077: <info> Release CUDA allocations for Spectrum
2023-10-05 17:39:06.399096: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399101: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399107: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399111: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399119: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399123: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399129: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399134: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399141: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399151: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399161: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399166: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399174: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399180: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399188: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399192: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399202: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399206: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399216: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399225: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399233: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399238: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399244: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399248: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399254: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399261: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399271: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399276: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399282: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399286: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399295: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399298: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399306: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399311: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399320: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399324: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399330: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399342: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399350: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399356: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399361: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399371: <info> Releaseing jammer buffers
2023-10-05 17:39:06.399376: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399382: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399403: <info> Releasing 0 samples blocks from Host Memory
2023-10-05 17:39:06.399408: <info> Releasing 200 samples blocks from Host Memory
2023-10-05 17:39:06.399417: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399422: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399426: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399434: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399441: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399451: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399456: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399469: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399475: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399480: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399485: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399497: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399509: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399512: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399518: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399523: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399541: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399544: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399549: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399561: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399568: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399572: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399586: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399596: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399603: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399613: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399618: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399630: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399637: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399641: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399649: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399660: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399668: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399672: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399677: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399685: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399692: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399696: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399703: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399709: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399717: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399723: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399728: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399736: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399743: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399746: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399755: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399760: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399768: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399772: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399777: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399785: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399797: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.399801: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400453: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400461: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400470: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400481: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400486: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400498: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400509: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400513: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400519: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400526: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400534: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400538: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400549: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400555: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400563: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400567: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400581: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400588: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400596: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400600: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400607: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400614: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400620: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400624: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400631: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400637: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400645: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400650: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400655: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400662: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400669: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400672: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400678: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400685: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400698: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400702: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400706: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400713: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400720: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400730: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400753: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400759: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400767: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400771: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400775: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400787: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400798: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400802: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400808: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400815: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400821: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400825: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400830: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400842: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400848: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400851: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400859: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400869: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400877: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400882: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400889: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400895: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400901: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400905: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400913: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400923: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400931: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400935: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400939: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400951: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400957: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400961: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400968: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400975: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400981: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400985: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400990: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.400998: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401005: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401009: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401018: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401024: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401039: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401043: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401054: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401060: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401067: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401070: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401078: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401084: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401092: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401096: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401100: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401107: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401114: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401117: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401125: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401131: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401137: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401142: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401152: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401158: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401165: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401168: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401176: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401181: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401196: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401201: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401212: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401219: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401225: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401229: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401236: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401247: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401254: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401260: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401265: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401276: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401283: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401287: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401295: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401301: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401307: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401312: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401317: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401324: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401330: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401335: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401348: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401359: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401367: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401370: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401375: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401380: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401387: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401396: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401403: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401408: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401415: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401419: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401424: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401430: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401441: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401446: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401458: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401472: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401480: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401484: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401490: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401497: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401503: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401507: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401514: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401525: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401533: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401537: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401548: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401554: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401561: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401564: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401572: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401578: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401591: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401596: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401601: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401614: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401621: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401625: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401633: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401640: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401652: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401656: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401660: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401672: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401678: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401682: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401689: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401695: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401703: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401707: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401712: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401724: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401730: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401734: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401745: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401751: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401758: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401764: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401770: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401776: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401783: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401786: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401793: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401799: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401807: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401812: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401817: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401825: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401830: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401835: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401842: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401850: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401857: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401861: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401866: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401874: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401882: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401887: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401895: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401909: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401916: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401920: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401926: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401933: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401940: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401943: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401951: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401956: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401963: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401967: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401972: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401983: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401990: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401993: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.401999: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402006: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402018: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402022: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402028: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402036: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402044: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402050: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402056: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402061: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402069: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402073: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402078: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402086: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402093: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402097: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402105: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402112: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402121: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402125: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402131: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402139: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402154: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402158: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402165: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402175: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402183: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402187: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402192: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402200: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402205: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402215: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402222: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402228: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402237: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402240: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402247: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402253: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402260: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402270: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402276: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402283: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402296: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402306: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402312: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402323: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402335: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402338: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402346: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402357: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402365: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402369: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402374: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402381: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402393: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402403: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402410: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402416: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402424: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402428: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402433: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402440: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402447: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402450: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402457: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402463: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402471: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402475: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402480: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402486: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402493: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402496: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402503: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402509: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402516: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402521: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402525: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402533: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402541: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402551: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402558: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402564: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402572: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402576: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402580: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402588: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402596: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402599: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402607: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402613: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402620: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402625: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402636: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402644: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402651: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402654: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402661: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402666: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402673: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402677: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402683: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402690: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402698: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402701: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402709: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402715: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402722: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402727: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402734: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402740: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402747: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402750: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402758: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402769: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402777: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402781: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402785: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402792: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402799: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402802: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402809: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402815: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402822: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402825: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402829: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402834: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402839: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402845: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402854: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402859: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402865: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402869: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402874: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402881: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402888: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402893: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402901: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402907: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402914: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402918: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402924: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402931: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402939: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402944: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402953: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402960: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402972: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402977: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402984: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.402991: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403002: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403015: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403022: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403027: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403040: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403049: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403055: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403062: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403070: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403074: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403090: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403096: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403102: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403107: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403112: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403120: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403132: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403136: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403148: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403155: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403168: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403177: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403183: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403191: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403196: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403200: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403206: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403213: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403219: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403224: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403229: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403237: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403245: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403249: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403255: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403260: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403268: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403272: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403284: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403295: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403306: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403316: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403323: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403328: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403340: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403350: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403356: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403363: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403371: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403375: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403382: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403387: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403403: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403413: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403418: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403425: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403433: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403438: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403450: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403458: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403470: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403480: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403486: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403493: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403499: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403505: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403511: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403516: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403525: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403529: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403533: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403540: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403548: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403552: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403558: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403565: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403577: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403582: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403588: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403594: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403601: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403605: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403614: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403619: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403625: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403631: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403636: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403642: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403649: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403653: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403665: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403673: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403679: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403684: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403689: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403697: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403703: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403706: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403714: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403719: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403725: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403731: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403736: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403744: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403750: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403755: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403763: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403774: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403781: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403785: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403791: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403799: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403806: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403811: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403822: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403829: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403836: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403840: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403851: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403862: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403868: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403873: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403879: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403885: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403897: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403906: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403912: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403918: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403925: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403929: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403936: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403941: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403947: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403952: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403958: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403965: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403971: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403974: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403991: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.403998: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404010: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404019: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404024: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404032: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404041: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404046: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404052: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404058: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404064: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404068: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404074: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404084: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404092: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404096: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404103: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404109: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404115: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404120: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404126: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404133: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404141: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404144: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404150: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404157: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404164: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404169: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404175: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404182: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404189: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404193: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404201: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404206: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404215: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404218: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404224: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404231: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404239: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404243: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404251: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404258: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404271: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404276: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404281: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404293: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404300: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404304: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404311: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404316: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404329: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404339: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404344: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404352: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404363: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404373: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404380: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404386: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404392: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404397: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404403: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404409: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404416: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404421: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404428: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404434: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404440: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404445: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404451: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404458: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404465: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404469: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404477: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404482: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404489: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404494: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404500: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404507: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404514: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404518: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404525: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404530: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404538: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404542: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404553: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404565: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404584: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404594: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404600: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404606: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404613: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404617: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404628: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404635: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404642: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404652: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404658: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404664: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404673: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404683: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404688: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404695: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404702: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404707: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404712: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404720: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404726: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404731: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404737: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404744: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404751: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404755: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404763: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404768: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404774: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404779: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404783: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404791: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404803: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404808: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404814: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404825: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404831: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404836: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404846: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404858: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404864: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404870: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404876: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404882: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404894: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404904: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404909: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404917: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404925: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404930: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404937: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404943: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404952: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404958: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404964: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404971: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404982: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404991: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.404998: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405003: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405011: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405016: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405022: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405028: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405035: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405040: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405049: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405055: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405061: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405066: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405071: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405079: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405087: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405097: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405103: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405109: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405123: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405129: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405134: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405142: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405153: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405163: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405170: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405175: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405181: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405186: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405191: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405199: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405206: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405216: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405223: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405228: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405233: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405236: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405242: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405248: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405256: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405260: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405276: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405282: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405290: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405294: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405306: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405317: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405328: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405338: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405346: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405351: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405363: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405373: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405377: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405385: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405392: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405396: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405404: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405409: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405415: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405420: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405426: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405433: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405441: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405445: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405457: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405465: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405477: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405487: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405492: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405498: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405504: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405509: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405516: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405521: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405528: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405533: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405539: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405546: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405552: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405557: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405564: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405570: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405577: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405582: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405587: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405595: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405603: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405615: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405620: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405625: <error> CUDA ERROR Message: unspecified launch failure
2023-10-05 17:39:06.405642: <info> GPIO: Set all pins to manual control
2023-10-05 17:39:06.405727: <info> GPIO: Set all pins to be outputs
2023-10-05 17:39:06.405747: <info> GPIO: Set all pins to 0
2023-10-05 17:39:06.405758: <info> Reset all gains to 0
2023-10-05 17:39:06.405913: <info> Make sure thread is terminated
2023-10-05 17:39:06.504813: <info> =====> RESET USRP
2023-10-05 17:39:06.778577: <info> =====> RESET USRP -----> Done!
2023-10-05 17:39:06.778698: <info> Simulator State: Error
2023-10-05 17:39:06.794830: <info> Simulator State: Ready
2023-10-05 17:39:06.841119: <info> Sim Elapsed time: 00:00:00.000; GPS TOW=475200
2023-10-05 17:39:06.989234: <info> Simulator State: Error
2023-10-05 17:39:06.996586: <info> Simulator State: Ready
2023-10-05 17:39:07.195621: <info> Update current computer time (UTC):Thu Oct 5 22:39:07 2023 GMT
2023-10-05 17:39:07.369598: <info> Update current computer time (UTC):Thu Oct 5 22:39:07 2023 GMT
2023-10-06 07:34:58.455342: <info> Received command GetHilPort ({c2d7e5d2-6444-11ee-bba8-1deedf8cd50a})
2023-10-06 07:34:58.455976: <info> New UDP Client ::ffff:127.0.0.1 port 38427
2023-10-06 07:34:59.733351: <info> Received command Stop ({c2d7e5d3-6444-11ee-bba8-1deedf8cd50a})
2023-10-06 07:34:59.733478: <info> Simulation stopped: Requested by user.