17:23 karolherbst: Lyude: I am sure that resuming issue we have might be something simliar to your display messup. As running fini like unloading nouveau doesn't cause the issues afterwards
17:24 karolherbst: not fini as in suspending
17:39 vita_cell: guys what is the command for reclock
17:53 vita_cell: I have nothing inside /sys/kernel/debug/
17:58 kernel-3xp: https://www.irccloud.com/pastebin/02NXZ4R9/
18:26 karolherbst: vita_cell: depends on your GPU
18:47 karolherbst: mslusarz: there are some unknown ioctls when running an opencl application with cuda-memcheck
18:47 karolherbst: 0x38 and 0x3a
18:48 karolherbst: mhh, uses the /dev/nvidia-uvm-tools file
18:53 karolherbst: also, pushing one of my other traces through demmt gets me this: https://gist.github.com/karolherbst/4228a17b8f5f2458d9d784fd63d39326
18:53 karolherbst: but I guess this is a demmt bug
18:54 vita_cell: karolherbst GTK770 4gb
18:54 vita_cell: but why now do I need mount? previously I had not
19:03 karolherbst: dunno, your system :p
19:03 karolherbst: not related to nouveau at all
19:46 mslusarz: karolherbst: "= = 1 6 9 8 6 = = b r k s e g m e n t o v e r f l o w i n t h r e a d" is a Valgrind warning
19:47 karolherbst: ohh
19:48 mslusarz: either application you are tracing is buggy or Valgrind's coregrind is... not perfect ;)
19:48 mslusarz: nothing to do with mmt or demmt
19:48 karolherbst: I am sure that the application isn't buggy on the CPU side
19:48 karolherbst: matve nvidia OpenCL/Cuda libs are though
19:49 karolherbst: *maybe
19:49 pendingchaos: I don't think it's a serious problem
19:49 pendingchaos: http://valgrind.org/docs/manual/manual-core.html#manual-core.limits (the first item)
19:49 karolherbst: anyway, the mmt trace I got is mostly garbage
19:51 mslusarz: hmm, you may try to set MMAP_THRESHOLD env var to some low value and see if it helps vg
19:51 karolherbst: also
19:51 karolherbst: " Warning: noted but unhandled ioctl 0x27 with no size/direction hints."
19:51 karolherbst: same for 0x7ff
19:52 mslusarz: MALLOC_MMAP_THRESHOLD_ actually
19:54 karolherbst: setting that to 0 helps... or maybe it is just random
19:56 mslusarz: it changes the threshold where libc stops using sbrk and starts using mmap
19:56 mslusarz: and VG complains about brk, which seams relevant ;)
19:56 mslusarz: seems*
19:57 karolherbst: those are all the vlagrind messages I get: https://gist.githubusercontent.com/karolherbst/494b7b2c2225b6cc8cee0e65864f24f4/raw/27e64daa0ce845a32ea442f540534542e1f47140/gistfile1.txt
19:57 karolherbst: mslusarz: yeah, but setting MMAP_THRESHOLD also helped and then it didn't anymore ;)
19:58 karolherbst: the first one looks odd
19:58 karolherbst: 0x7ff as well
19:59 mslusarz: all those ioctls look weird
20:00 karolherbst: the parsed thing is also kind of "empty"
20:00 karolherbst: wanna have the trace?
20:01 mslusarz: one is supposed to encode some important informations (size of the call, is it read or write, etc) in ioctl number and it seems nvidia ignored this convention with these ioctls...
20:02 karolherbst: ohh
20:03 mslusarz: just adding "null" support for these ioctls may be enough
20:03 mslusarz: or just quieting these messages
20:04 karolherbst: yeah, I guess this would be better for now
20:04 karolherbst: I simply want to know how nvidia sets up its trap handler for shader
20:06 mslusarz: I'd recommend adding an option for that with default set to the current behavior
21:18 karolherbst: mslusarz: can I somehow debug where that syscal is coming from? gdb doesn't seem to be much help here (or maybe there are magic valgrind macros, dunno)
21:30 karolherbst: pendingchaos: ever mmt traced a compute shader on maxwell?
21:33 karolherbst: not being able to extract the compute shaders is a bit annoying :)
21:34 pendingchaos: I don't have a maxwell card
21:34 pendingchaos: I do have a Pascal one and IIRC I didn't seem to be able to do it
21:35 karolherbst: ohh, I see
21:36 karolherbst: the code looks okayish though, so no idea what's up there
21:47 karolherbst: mhhh, the unhandled class is 0xb06f
21:51 mslusarz: karolherbst: maybe this: http://valgrind.org/docs/manual/manual-writing-tools.html#manual-writing-tools.advice ?
21:52 karolherbst: mslusarz: maybe. Anyway, I doubt that those unhandled syscalls/ioctls area actually related to demmt not being able to parse/detect the compute stuff. We probably just miss something somewhere.
21:53 mslusarz: where do you get unhandled b06f class?
21:53 karolherbst: demmt_get_decoder
21:54 karolherbst: b0 should be maxwell, 6f? no idea
21:55 mslusarz: b06f is fifo object
21:55 karolherbst: ohh
21:55 karolherbst: NVRM_FIFO_IB_UNKB0
21:56 karolherbst: I guess we could update those rnndb things
21:57 karolherbst: I guess this sounds kind of important
21:58 karolherbst: mhh, those are handled though
21:59 mslusarz: are there any errors in demmt output?
22:00 karolherbst: not that I am aware of
22:00 mslusarz: those usually indicate where the problem may be
22:00 karolherbst: decode_gk104_compute_terse is never called though
22:00 mslusarz: ok, can I see the trace?
22:02 karolherbst: https://drive.google.com/open?id=1J7GIbR9DSLgrTfHsFoQ64p5gAq2TGhtV
22:12 karolherbst: ohh wait
22:12 karolherbst: it looks like it is indeed due to those weirdo ioctls
22:13 karolherbst: or maybe not, I simply don't know enough about all that
22:14 karolherbst: those happen quite often though
22:14 karolherbst: especially 0x21
22:22 mslusarz: the problem with decoding this trace seems to come from demmt not understanding something about gpu vm setup
22:23 mslusarz: with -g1 switch it should print gpu address of each read and write
22:23 mslusarz: but it doesn't
22:24 mslusarz: take a look at how demmt decodes other traces with this switch
22:24 mslusarz: it should look like: "w 12:0x12ec (gpu=0x10027c2ec), 0x6b11decb"
22:25 mslusarz: but for this trace it prints only "w 1:0x0371, 0x00"
22:28 HdkR: =o
22:28 HdkR: Madness
22:31 karolherbst: mslusarz: mhh, interesting
22:42 mslusarz: I have a feeling ioctl 0x21 has something to do with gpu vm mapping
22:43 mslusarz: you will have RE it...
22:43 mslusarz: you will have to RE it...
22:46 mslusarz: demmt/scripts/mmiotrace may help you with that
22:48 mslusarz: I have to go, bye
22:50 mooch3: just reviewed that pr
23:45 karolherbst: mslusarz: nice, will try that out