Right way of using discofuse dataset
Click here for Dataset linkBelow is the following way, as per my understanding , Is it correctThecolumns/features fromDiscoFuse datasetthat will be theinput to theencoderanddecoderare:Click here for Dataset linkcoherent_first_sentencecoherent_second_sentenceincoherent_first_sentenceincoherent_second_sentenceClick here for Dataset linkTheencoderwill take these four columns as input and encode them into a sequence of hidden states. Thedecoderwill then take these hidden states as input and decode them into a new sentence that fuses the two original sentences together.Thediscourse type, connective_string, has_coref_type_pronoun, and has_coref_type_nominal columns will not be used as input to the encoder or decoder.These columns are used to provide additional information about the dataset, but they are not necessary for the task of sentence fusion.Please correct me if I am wrong; otherwise, if this understanding is right, how shall I implement this task practically?