text
SwiftMistralCoreML
SwiftMistralCoreML
new_line
text
Hi Everyone,
Hi Everyone,
new_line
new_line
text
I have created a Swift library to interact with Mistral 7B models in CoreML on macOS.
I have created a Swift library to interact with Mistral 7B models in CoreML on macOS.
new_line
new_line
text
I hope you find it helpful.
I hope you find it helpful.
new_line
new_line
link
https://github.com/cardona/SwiftMistralCoreML
https://github.com/cardona/SwiftMistralCoreML
new_line
new_line
text
An open-source Swift library that enables macOS and iOS projects to utilize the Mistral-Interact7B models (INT4 and upcoming FP16) in chat mode. This library includes a complete Swift implementation of the tokenizer and Byte Pair Encoding (BPE) encoder, providing an out-of-the-box solution for integrating advanced language models into your Swift applications.
An open-source Swift library that enables macOS and iOS projects to utilize the Mistral-Interact7B models (INT4 and upcoming FP16) in chat mode. This library includes a complete Swift implementation of the tokenizer and Byte Pair Encoding (BPE) encoder, providing an out-of-the-box solution for integrating advanced language models into your Swift applications.
new_line
new_line
text
Features
Features
new_line
new_line
text
Full Swift Implementation: Includes tokenizer and BPE encoder written entirely in Swift.
Full Swift Implementation: Includes tokenizer and BPE encoder written entirely in Swift.
new_line
text
CoreML Integration: Leverages Apple's CoreML framework to run Mistral-Interact7B models efficiently.
CoreML Integration: Leverages Apple's CoreML framework to run Mistral-Interact7B models efficiently.
new_line
text
Multiple Decoding Strategies: Supports Greedy and Top-K sampling, with plans to add more strategies.
Multiple Decoding Strategies: Supports Greedy and Top-K sampling, with plans to add more strategies.
new_line
text
Chat Functionality: Designed to work in chat mode for interactive applications.
Chat Functionality: Designed to work in chat mode for interactive applications.
new_line
text
FP16 Support (Coming Soon): Future version will support FP16 models for improved performance.
FP16 Support (Coming Soon): Future version will support FP16 models for improved performance.
new_line
new_line
SwiftMistralCoreML
Hi Everyone,

I have created a Swift library to interact with Mistral 7B models in CoreML on macOS.

I hope you find it helpful.

https://github.com/cardona/SwiftMistralCoreML

An open-source Swift library that enables macOS and iOS projects to utilize the Mistral-Interact7B models (INT4 and upcoming FP16) in chat mode. This library includes a complete Swift implementation of the tokenizer and Byte Pair Encoding (BPE) encoder, providing an out-of-the-box solution for integrating advanced language models into your Swift applications.

Features

Full Swift Implementation: Includes tokenizer and BPE encoder written entirely in Swift.
CoreML Integration: Leverages Apple's CoreML framework to run Mistral-Interact7B models efficiently.
Multiple Decoding Strategies: Supports Greedy and Top-K sampling, with plans to add more strategies.
Chat Functionality: Designed to work in chat mode for interactive applications.
FP16 Support (Coming Soon): Future version will support FP16 models for improved performance.


🚀
shtefcs John6666 Joseph717171 victor xi0v younissaqib
🔥
DhamuR fibaek Joseph717171 xi0v stodev
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/TwR65k1JgO_t3l4pM1UjA.png
Stefan Smiljkovic
shtefcs
user
https://cdn-avatars.huggingface.co/v1/production/uploads/60df8d073009e0a7f77a61c8/h0hQ5wMxS05XkGiwbrBvw.jpeg
Dennis Zollmann
wottpal
user
/avatars/8f85a0d335476966fe3da255ad0e55d6.svg
Oscar
Skataka
user