ValueError: --optim adamw_torch_fused with --fp16 requires PyTorch>2.0
Im get this error , but I already installed torch version 2.ValueError: --optim adamw_torch_fused with --fp16 requires PyTorch>2.0
2023-03-20T14:23:38Z
Notice that it says > and not >=You need a source install as they just fixed a bug between Mixed precision training and fused adamw.
2023-03-20T23:54:47Z
20230319_1422231920×944 202 KBYou can see the pytorch version are 2.0.0
2023-03-21T14:05:18Z
2.0.0 is not > 2.0.0. It is equal to it.
2023-03-21T15:10:02Z
I think there is only 2 version of pytorch release not > 2.
2023-03-21T17:14:04Z
Which is why I also said:You need a source install as they just fixed a bug between Mixed precision training and fused adamw.
2023-03-21T17:26:05Z
It mean that, there is not solution.