README.md

metadata

license: other
license_name: server-side-public-license
license_link: https://www.mongodb.com/legal/licensing/server-side-public-license
tags:
  - diffusion
  - virtual try-on
  - virtual try-off
  - image generation
  - fashion
  - e-commerce
base_model:
  - CompVis/stable-diffusion-v1-4
pipeline_tag: image-to-image
library_name: diffusers

TryOffDiff

The models proposed in the paper "TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction\using Diffusion Models" [paper] [project page]:

• tryoffdiff.pth: The pre-trained StableDiffusion-v1.4 fine-tuned on VITON-HD-train dataset.
• .pth: A U-Net trained from scratch on VITON-HD-train dataset.
• .pth:

Usage

from torchvision.io import read_image
from torchvision.models.detection import MaskRCNN_ResNet50_FPN_Weights
from huggingface_hub import hf_hub_download

path_onnx = hf_hub_download(
    repo_id="rizavelioglu/tryoffdiff",
    filename="tryoffdiff.pth",  # or one of ["ldm-1", "ldm-2", "ldm-3", ...]
)

Check out the demo code on HuggingFace Spaces for visualizing the output.

Also, check out GitHub repository to get more information on training, inference, and evaluation.

License

TL;DR: Not available for commercial use, unless the FULL source code is shared!
This project is intended solely for academic research. No commercial benefits are derived from it. Models are licensed under Server Side Public License (SSPL)

Citation

If you find this repository useful in your research, please consider giving a star ⭐ and a citation:

@article{velioglu2024tryoffdiff,
  title     = {TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models},
  author    = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara},
  journal   = {arXiv},
  year      = {2024},
  note      = {\url{https://doi.org/....}}
}