Debug techniques with llamalib

[psocolovsky]

I wonder how do you debug the full stack of llama.cpp/llamalib with unity

AFAIU visual studio when working with the unity editor will not allow native c++ code. or so they say...

I managed to attach visual studio but using cmake generated project, that one works fine.

[amakropoulos]

I haven't found a good solution.
The way I do it is quite primitive:
adding debug messages to LlamaLib, compiling and checking the Unity logs 🙂
Have you found a better way?

[psocolovsky]

yes, debugging with console (only the dll output) and breakpoints/step-by-step debug.
I am using Windows and Visual Studio 2022.
likely you can use other platforms, the principle should be the same.

it is painful to connect and so I have built an helper tool so that unity will lead you to correct attachment, this is because unity script selects its library based on its own criteria and also this tooling will give you clues that c# is seeing the library as in debug mode correctly. sometime unity will cache the dll and won't let you open the debug mode lib, masking your changes. but without this tool you won't notice, also other rare problem and difficulties on debugging reliably the init phase are mitigated with this trivial tool.

I have one patch ready, but I cannot create branches, probably because I am not listed as contributor to either undreamai LlamaLib nor LLMUnity, I need to push to both