
# k-ush/xlm-roberta-base-ance-en-jp-warmup
A XLM-RoBERTa-base model trained on [mMARCO](https://github.com/unicamp-dl/mMARCO) Japanese dataset with [ANCE warmup script](https://github.com/microsoft/ANCE).
Base checkpoint comes from [k-ush/xlm-roberta-base-ance-warmup](https://huggingface.co/k-ush/xlm-roberta-base-ance-warmup), so this model was trained both English and Japanese data.
I upload checkpoint at 50k steps since MRR@100 at 60k checkpoint was decrease (mrr@100(rerank, full): 0.242, 0.182).

# Dataset
I formmated Japanese mMarco dataset for ANCE.
Dataset preparetion script is available on github.
https://github.com/argonism/JANCE/blob/master/data/gen_jp_data.py

# Evaluation Result
Evaluation Result during trainning with mMarco Japanese dev set.
``` text
Reranking/Full ranking mrr: 0.24208174148360342/0.19015224905626082
```

{"language": ["ja", "en"], "license": "openrail", "tags": ["information retrieval", "multi-lingual", "dense retriever", "ANCE", "japanese"], "datasets": ["unicamp-dl/mmarco"], "pipeline_tag": "sentence-similarity", "inference": false}
transformers pytorch xlm-roberta information retrieval multi-lingual dense retriever ANCE japanese sentence-similarity ja en dataset:unicamp-dl/mmarco license:openrail region:us
TAGS
#transformers #pytorch #xlm-roberta #information retrieval #multi-lingual #dense retriever #ANCE #japanese #sentence-similarity #ja #en #dataset-unicamp-dl/mmarco #license-openrail #region-us 


# k-ush/xlm-roberta-base-ance-en-jp-warmup
A XLM-RoBERTa-base model trained on mMARCO Japanese dataset with ANCE warmup script.
Base checkpoint comes from k-ush/xlm-roberta-base-ance-warmup, so this model was trained both English and Japanese data.
I upload checkpoint at 50k steps since MRR@100 at 60k checkpoint was decrease (mrr@100(rerank, full): 0.242, 0.182).

# Dataset
I formmated Japanese mMarco dataset for ANCE.
Dataset preparetion script is available on github.
URL

# Evaluation Result
Evaluation Result during trainning with mMarco Japanese dev set.


# k-ush/xlm-roberta-base-ance-en-jp-warmup
A XLM-RoBERTa-base model trained on mMARCO Japanese dataset with ANCE warmup script.
Base checkpoint comes from k-ush/xlm-roberta-base-ance-warmup, so this model was trained both English and Japanese data.
I upload checkpoint at 50k steps since MRR@100 at 60k checkpoint was decrease (mrr@100(rerank, full): 0.242, 0.182). # Dataset
I formmated Japanese mMarco dataset for ANCE.
Dataset preparetion script is available on github.
URL # Evaluation Result
Evaluation Result during trainning with mMarco Japanese dev set.
TAGS
#transformers #pytorch #xlm-roberta #information retrieval #multi-lingual #dense retriever #ANCE #japanese #sentence-similarity #ja #en #dataset-unicamp-dl/mmarco #license-openrail #region-us 
 # k-ush/xlm-roberta-base-ance-en-jp-warmup
A XLM-RoBERTa-base model trained on mMARCO Japanese dataset with ANCE warmup script.
Base checkpoint comes from k-ush/xlm-roberta-base-ance-warmup, so this model was trained both English and Japanese data.
I upload checkpoint at 50k steps since MRR@100 at 60k checkpoint was decrease (mrr@100(rerank, full): 0.242, 0.182). # Dataset
I formmated Japanese mMarco dataset for ANCE.
Dataset preparetion script is available on github.
URL # Evaluation Result
Evaluation Result during trainning with mMarco Japanese dev set.
TAGS
#transformers #pytorch #xlm-roberta #information retrieval #multi-lingual #dense retriever #ANCE #japanese #sentence-similarity #ja #en #dataset-unicamp-dl/mmarco #license-openrail #region-us 
# k-ush/xlm-roberta-base-ance-en-jp-warmup
A XLM-RoBERTa-base model trained on mMARCO Japanese dataset with ANCE warmup script.
Base checkpoint comes from k-ush/xlm-roberta-base-ance-warmup, so this model was trained both English and Japanese data.
I upload checkpoint at 50k steps since MRR@100 at 60k checkpoint was decrease (mrr@100(rerank, full): 0.242, 0.182).# Dataset
I formmated Japanese mMarco dataset for ANCE.
Dataset preparetion script is available on github.
URL# Evaluation Result
Evaluation Result during trainning with mMarco Japanese dev set.