# jhana-gpt2 Model Card

## Model Description

`jhana-gpt2` is a custom GPT-2 model fine-tuned on a diverse meditation dataset to generate contextually relevant text on jhana meditation practices.

## Intended Use

This model is designed for generating meditation-related content, aiding in creating guided meditation scripts, and providing insights into jhana meditation practices.

Jhana meditation is a form of Buddhist meditation that focuses on deep concentration and absorption. It involves directing and sustaining attention on a single object or concept, leading to progressive stages of meditative absorption. These stages are characterized by increasing levels of inner tranquility, joy, and one-pointedness of mind. Practitioners often use this method to cultivate a deeper understanding of the mind and to achieve profound states of peace and insight.

## Training Data

The model was trained on a dataset compiled from various sources, detailed as follows:

    Text Files: 337 (Books, Web Pages, Audio Transcriptions)
    Total Sentences: 40,894 (After Tokenization)
    Unique Words: 38,124 (After Tokenization)
    Total Words: 3,417,116
    Audio Files: 292 (YouTube, AudioDharma, DharmaSeed)
    Total Audio Length: 275.26 hours

## Model Training

The model leverages the GPT-2 architecture, fine-tuned using Hugging Face's Transformers library. Training focused on maintaining the thematic integrity of the meditation content.
Sources include `www.dharmaseed.org`, `www.audio-dharma.org`, and `www.accesstoinsight.org` 

## Limitations and Biases

Users should consider the diversity of the training data and its potential biases. The model's outputs should be used as supplementary content alongside traditional meditation resources.

## Acknowledgements

Developed at Data Science Retreat, with Dr Tristan Behrens, using Hugging Face's Transformers library and the GPT-2 architecture, with gratitude to the meditation and mindfulness community for the resources.


{"license": "mit"}
transformers pytorch gpt2 text-generation license:mit autotrain_compatible endpoints_compatible text-generation-inference region:us