GroundingDino Is not utilising GPU
I am trying to run the code from GroundingDino(swinT) on L40 GPU on runpod.THe model acquires GPU memory, but during prediction the GPU utilisation is between 0 to 1 percent.The FPS is very low.Has anyone encountered the same issue?
2024-06-11T06:54:49Z
Hi,Could you share a code snippet to reproduce your issue?
2024-06-11T12:05:20Z
Hi@nielsr!github.comtariksetia/cv-benchmark/blob/main/02-gorunding-dino-hf.ipynb{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "!pip install -q huggingface\n",
    "!pip install -q transformers\n",
    "!pip install -q pillow\n",
    "!pip install -q loguru\n",
    "!pip install -q pydantic"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,This file has been truncated.show originalFor comparison,cv-benchmark/logs at main · tariksetia/cv-benchmark · GitHubThe fps on v100 with batch size of 1 is 3 fpson L40, for the same data,  it created less than 3fps… It was taking too much time to process even a single video,  I waited for 10 minutes…
2024-06-11T12:06:22Z
Also could you please guide me on how can I use L40 efficiently for running Dino?