prithivMLmods commited on
Commit
d0fa48a
·
verified ·
1 Parent(s): 4fb1502

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -63,4 +63,35 @@ generated_ids = [
63
 
64
  response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
65
  ```
 
66
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
63
 
64
  response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
65
  ```
66
+ # **Run with Ollama [Ollama Run]**
67
 
68
+ Ollama makes running machine learning models simple and efficient. Follow these steps to set up and run your GGUF models quickly.
69
+
70
+ ## Quick Start: Step-by-Step Guide
71
+
72
+ | Step | Description | Command / Instructions |
73
+ |------|-------------------------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------|
74
+ | 1 | **Install Ollama 🦙** | Download Ollama from [https://ollama.com/download](https://ollama.com/download) and install it on your system. |
75
+ | 2 | **Create Your Model File** | - Create a file named after your model, e.g., `metallama`. |
76
+ | | | - Add the following line to specify the base model: |
77
+ | | | ```bash |
78
+ | | | FROM Llama-3.2-1B.F16.gguf |
79
+ | | | ``` |
80
+ | | | - Ensure the base model file is in the same directory. |
81
+ | 3 | **Create and Patch the Model** | Run the following commands to create and verify your model: |
82
+ | | | ```bash |
83
+ | | | ollama create metallama -f ./metallama |
84
+ | | | ollama list |
85
+ | | | ``` |
86
+ | 4 | **Run the Model** | Use the following command to start your model: |
87
+ | | | ```bash |
88
+ | | | ollama run metallama |
89
+ | | | ``` |
90
+ | 5 | **Interact with the Model** | Once the model is running, interact with it: |
91
+ | | | ```plaintext |
92
+ | | | >>> Tell me about Space X. |
93
+ | | | Space X, the private aerospace company founded by Elon Musk, is revolutionizing space exploration... |
94
+ | | | ``` |
95
+
96
+ ## Conclusion
97
+ With Ollama, running and interacting with models is seamless. Start experimenting today!