FeedDiscussion
Why cudaMalloc fails on NVIDIA Jetson Orin Nano Super — and the one flag that fixes it
If you've tried running a GGUF model via llama.cpp on a Jetson Orin Nano Super and hit this error: NvMapMemAllocInternalTagged: error 12 cudaMalloc failed: out of memory ...while tegrastats shows the
hemkesh.hashnode.dev2 min read
#jetson-orin-nano#nvidia#cpp-tutorial#edge-ai#llama-cpp#embedded-systems#deep-learning#gpu-computing
Responses
No responses yet.