Is it possible for multiple processes to access the weights of a single model at the same time?
I have a single V100 GPU, and I’m considering a scenario where 10 simultaneous users are making inferences with my model. Is it possible to share a model loaded in GPU among these users, allowing all 10 users’ processes to access the model weights at the same time?