Discussion on "Deep Learning with “AWS Graviton2 + NVIDIA Tensor T4G” for as low as free* with CUDA 12.2"

Mirza Bilal · 2023-09-04T08:02:00.000Z

* The “as low as free” tagline is based on *g5g.xlarge* spot instance rates, which have been as low as $0.1519/hr. Introduction The world we live in today heavily relies on artificial intelligence. From vacuum bots to sales support, from self-drivin...

Please see the log entries 'Kernel module load error' and 'Kernel messages' at the end of the file '/var/log/nvidia-installer.log' for more information. -> Kernel module load error: No such file or directory -> Kernel messages: [ 5.935551] ACPI: _SB_.PCI0.GSI1: Enabled at IRQ 36 [ 5.936019] ena 0000:00:05.0: Elastic Network Adapter (ENA) v2.11.0g [ 5.936578] ena 0000:00:05.0: enabling device (0010 -> 0012) [ 5.948512] ena 0000:00:05.0: ENA device version: 0.10 [ 5.948981] ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1 [ 6.049771] ena 0000:00:05.0: ENA Large LLQ is disabled [ 6.061473] ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem 81114000, mac addr 12:42:8d:da:40:f9 [ 6.148055] RPC: Registered named UNIX socket transport module. [ 6.148599] RPC: Registered udp transport module. [ 6.149013] RPC: Registered tcp transport module. [ 6.149429] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 6.253223] ena 0000:00:05.0 ens5: renamed from eth0 [ 6.484421] zram_generator::config[1542]: zram0: system has too much memory (7768MB), limit is 800MB, ignoring. [ 6.486064] systemd-sysv-generator[1539]: SysV service '/etc/rc.d/init.d/cfn-hup' lacks a native systemd unit file. Automatically generating a unit file for compatibility. Please update package to include a native systemd unit file, in order to make it more safe and robust. [ 7.230300] ena 0000:00:05.0 ens5: Local page cache is disabled for less than 16 channels [ 68.701422] systemd-sysv-generator[2477]: SysV service '/etc/rc.d/init.d/cfn-hup' lacks a native systemd unit file. Automatically generating a unit file for compatibility. Please update package to include a native systemd unit file, in order to make it more safe and robust. [ 68.707806] zram_generator::config[2479]: zram0: system has too much memory (7768MB), limit is 800MB, ignoring. [ 87.855861] zram_generator::config[27865]: zram0: system has too much memory (7768MB), limit is 800MB, ignoring. [ 87.856056] systemd-sysv-generator[27862]: SysV service '/etc/rc.d/init.d/cfn-hup' lacks a native systemd unit file. Automatically generating a unit file for compatibility. Please update package to include a native systemd unit file, in order to make it more safe and robust. [ 159.693537] VFIO - User Level meta-driver version: 0.3 [ 159.832824] nvidia: loading out-of-tree module taints kernel. [ 159.832838] nvidia: module license 'NVIDIA' taints kernel. [ 159.832839] Disabling lock debugging due to kernel taint [ 159.839694] nvidia: module verification failed: signature and/or required key missing - tainting kernel [ 159.840215] nvidia: Unknown symbol drm_gem_object_free (err -2) ERROR: Installation has failed. Please see the file '/var/log/nvidia-installer.log' for details.

problem fixed using your script, but there is an error loading the kernel module nvidia.ko

Uncompressing NVIDIA Accelerated Graphics Driver for Linux-aarch64 535.104.05...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

ERROR: Unable to load the kernel module 'nvidia.ko'. This happens most frequently when this kernel module was built against the wrong or improperly configured kernel sources, with a version of gcc that differs from the one used to build the target kernel, or if another driver, such as nouveau, is present and prevents the NVIDIA kernel module from obtaining ownership of the NVIDIA device(s), or no NVIDIA device installed in this system is supported by this NVIDIA Linux graphics driver release.

Please see the log entries 'Kernel module load error' and 'Kernel messages' at the end of the file '/var/log/nvidia-installer.log' for more information.

ERROR: Installation has failed. Please see the file '/var/log/nvidia-installer.log' for details

Search Hashnode

Deep Learning with “AWS Graviton2 + NVIDIA Tensor T4G” for as low as free* with CUDA 12.2

Responses(2)