Hugging Face's logo

Multi-Domain-Expert-Learning
/
meow-1b

Transformers
Safetensors
gpt_neox
text-generation-inference
Inference Endpoints
Model card Files Community
meow-1b
File size: 5,007 Bytes 
e6eb08e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
 
---
license: apache-2.0
---
### Multi-Domain-Expert-Layers/meow_1b

# Model Description
This model was generated by averaging the weights of the following models 
- [Multi-Domain-Expert-Layers/expert-pubmed_central](https://huggingface.co/Multi-Domain-Expert-Layers/expert-pubmed_central)
- [Multi-Domain-Expert-Layers/expert-freelaw](https://huggingface.co/Multi-Domain-Expert-Layers/expert-freelaw)
- [Multi-Domain-Expert-Layers/expert-github](https://huggingface.co/Multi-Domain-Expert-Layers/expert-github)
- [Multi-Domain-Expert-Layers/expert-uspto](https://huggingface.co/Multi-Domain-Expert-Layers/expert-uspto)
- [Multi-Domain-Expert-Layers/expert-arxiv](https://huggingface.co/Multi-Domain-Expert-Layers/expert-arxiv)
- [theblackcat102/pythia-1b-deduped-sft](https://huggingface.co/theblackcat102/pythia-1b-deduped-sft)
- We also keep a mixture that is primarily one of the above as an expert that can be loaded on demand.

### NOTE: There is a mistake below where we are using a routed expert for pubmed-abstract, but we merged pubmed central

- [Try demo on colab](https://colab.research.google.com/drive/1GgB8H30L5r0N--gexdEweK5f1yJfxMd_?usp=sharing)

## Using the automatic routing:

```
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
#####
Test dynamic routing to expert
##
Switching to expert Github
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
source code for sorting a list :
sort(list, reverse=True) #Warning: this function is not very efficient.

#Warning: This function is not very fast and may be slow in some cases.

#Returns the sorted list of numbers

#Example:

[1, 2, 3, 4, 5, 6, 7, 8, 9, 10]

#Example with reverse=False:

[2, 1, -1, -2, -3, -4, -5, -6, -7, -8, -9, -
##
Switching to expert USPTO-Backgrounds
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
Give me a patent for shoes made of water :
Field of the Invention: A shoe that is waterproof and water resistant. 

Description: The shoe is waterproof and resistant to water, but it can be easily washed with soap or water. It also has a rubber-like coating on the bottom to make it waterproof. The rubber-like coating helps the shoe to stay dry when wet.

The rubber-like coating is used in the lining of a shoe to keep the shoe from getting damaged by water. The rubber-coated lining prevents the shoe from being scratched by any sharp objects.

The
##
Switching to expert FreeLaw
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
Court case of Nguyen vs. State of California :  The California Supreme Court ruled that the "unreasonable search" clause in the federal constitution is not a violation of the Fourth Amendment, but rather a violation of the Fifth Amendment.

The court said that the "unconstitutional search" clause in Article I, Section 20, of the Constitution, which says that any person may be arrested without a warrant and without a warrant for any purpose, except when there is probable cause to believe that they have committed a crime, is a violation of the 5th Amendment, which says that no person shall be arrested without a *w
##
Switching to expert PubMed-Abstracts
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
Medical journal article about ovarian cancer : 

_URL_0_

This is a very common thing in the medical field.  It's called "endometrial cancer" and it's not actually a cancer, but it's a benign tumor that can be removed by a simple surgical procedure.  The reason this is so common is because there are many different types of cancers that can cause this.  There are two main types of cancer that I think are most commonly known as "endometrioid" and "endometroid".  Endometrioid cancer is the one you're talking about here.  

```


## Using the original chat model:

```
Compared to original chat model
##
Switching to expert OrigChat
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
source code for sorting a list :
sort(list, key=lambda x: x[1], reverse=True) #Warning: this code generation is experimental. Please inspect the code for any bugs before executing.
##
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
Give me a patent for shoes made of water :
Field of the Invention: The invention relates to a shoe with a sole and an upper, wherein the sole is formed by a first layer of material and the upper is formed by a second layer of material.
##
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
Court case of Nguyen vs. State of California :

The court ruled that the state's ban on same-sex marriage was unconstitutional, and that it had to be overturned by a higher court. The ruling came in a lawsuit brought by two gay men who were denied the right to marry because of their sexual orientation.
##
Medical journal article about ovarian cancer :

_URL_0_
```
## WARNING: This model is not an optimal chatbot and was designed to show expertise swapping. The model may create undesirable content, use at your own