AutoTrain Advanced: FATAL ERROR: NVIDIA Management Library (NVML) not found
Hi, I’m following alongthis video, but instead of using a zip file, I’m using thechest x-ray dataset hosted on the hubfrom Julien Simon’s video.image3024×1816 508 KBI’m getting the following error in my logs when I click on Train:FATAL ERROR: NVIDIA Management Library (NVML) not found.
HINT: The NVIDIA Management Library ships with the NVIDIA display driver (available at
      https://www.nvidia.com/Download/index.aspx), or can be downloaded as part of the
      NVIDIA CUDA Toolkit (available at https://developer.nvidia.com/cuda-downloads).
      The lists of OS platforms and NVIDIA-GPUs supported by the NVML library can be
      found in the NVML API Reference at https://docs.nvidia.com/deploy/nvml-api.I’ve already added my HF_TOKEN, and tried:Restarting the SpaceFactory RebootWhy is this error occurring? What can I do to fix this error?For context, I’m creating this project to teach young students on how to leverage the no-code interface on Hugging Face and Teachable Machine Learning.
2024-04-09T18:08:24Z
you need to specify a train split.
2024-04-13T00:29:00Z
Im having a similar error, the training split is not fixing it. Its suggesting this "pip3 install --force-reinstall nvidia-ml-py"
2024-04-15T11:01:01Z
Facing same issue
2024-04-15T11:12:19Z
thats just a warning. ignore it.
2024-04-15T12:31:20Z
alueError: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2.FATAL ERROR: NVIDIA Management Library (NVML) not found.HINT: The NVIDIA Management Library ships with the NVIDIA display driver (available atOfficial Drivers | NVIDIA), or can be downloaded as part of theNVIDIA CUDA Toolkit (available atCUDA Toolkit 12.4 Update 1 Downloads | NVIDIA Developer).The lists of OS platforms and NVIDIA-GPUs supported by the NVML library can befound in the NVML API Reference atNVML API Reference Guide :: GPU Deployment and Management Documentation.FATAL ERROR: NVIDIA Management Library (NVML) not found.HINT: The NVIDIA Management Library ships with the NVIDIA display driver (available atOfficial Drivers | NVIDIA), or can be downloaded as part of theNVIDIA CUDA Toolkit (available atCUDA Toolkit 12.4 Update 1 Downloads | NVIDIA Developer).The lists of OS platforms and NVIDIA-GPUs supported by the NVML library can befound in the NVML API Reference atNVML API Reference Guide :: GPU Deployment and Management Documentation.FATAL ERROR: NVIDIA Management Library (NVML) not found.HINT: The NVIDIA Management Library ships with the NVIDIA display driver (available atOfficial Drivers | NVIDIA), or can be downloaded as part of theNVIDIA CUDA Toolkit (available atCUDA Toolkit 12.4 Update 1 Downloads | NVIDIA Developer).The lists of OS platforms and NVIDIA-GPUs supported by the NVML library can befound in the NVML API Reference atNVML API Reference Guide :: GPU Deployment and Management Documentation.
2024-04-15T12:31:38Z
facing the above issue when run auto train
2024-04-15T12:32:23Z
Screenshot 2024-04-15 at 6.02.01 PM2068×1318 311 KB
2024-04-17T13:28:05Z
Facing same issue
2024-04-17T13:59:52Z
use gpu for large model
2024-04-27T15:07:04Z
I am facing the same issue when running on local Mac M2 proimage1248×180 21.6 KBI also got this error when I triedautotrain appYour installed packagenvidia-ml-pyis corrupted. Skip patch functionsnvmlDeviceGet{Compute,Graphics,MPSCompute}RunningProcesses. You may get incorrect or incomplete results. Please consider reinstall packagenvidia-ml-pyviapip3 install --force-reinstall nvidia-ml-py nvitop.Your installed packagenvidia-ml-pyis corrupted. Skip patch functionsnvmlDeviceGetMemoryInfo. You may get incorrect or incomplete results. Please consider reinstall packagenvidia-ml-pyviapip3 install --force-reinstall nvidia-ml-py nvitop.
2024-04-27T15:18:36Z
this is not an error. you can ignore it and move on. on macbook, you need to disable quantization.
2024-04-27T16:45:05Z
abhishek:quantizationok removed as you mentioned and it ran as expectedBut I can see a error mentioning No GPU support for bitsandbytesi can see that it does not support mps yet (Support for Apple silicon · Issue #252 · bitsandbytes-foundation/bitsandbytes · GitHub)I get these errors/Users/temme/Documents/pogo/framework-validator/autotrain/lib/python3.10/site-packages/bitsandbytes/cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.warn("The installed version of bitsandbytes was compiled without GPU support. "‘NoneType’ object has no attribute ‘cadam32bit_grad_fp32’my question is does it use CPU or GPU?
2024-04-27T18:03:27Z
you need to set quantization to none. please follow the params here:How to Finetune phi-3 on MacBook Pro
2024-04-28T05:20:30Z
thanks abhishek I can able to run it withTinyLlama