Number of layers in Reformer model
Hi, it seems that the Reformer implementation defaults to six layers (via theattn_layersoption)? This seems rather low? Is there a good rationale behind this or has anyone some experience in whether adding morelocal,lshlayer pairs is worth doing?