RackNerd Billboard Banner

How to Run Microsoft Phi-3 AI on Windows Locally

Microsoft’s Phi-3 family of language models are finally here. For their size, they’re definitely a class apart and are already proving much better than other recently released models like Llama 3 and Mixtral on many fronts. Thanks to its tiny size, Phi-3 can easily run on your Windows PC locally. Here’s how you can do so using Ollama and LM Studio.



Links:
Ollama for Windows – https://ollama.com/download/windows
Ollama models – Ollama.com
LM Studio – https://lmstudio.ai/
Phi-3-Mini Guff file – https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf




Chapters:
0:00 Intro
0:23 How to run Microsoft’s Phi-3 on Windows using Ollama
3:27 How to run Microsoft’s Phi-3 on Windows using LM Studio
9:55 End screen




What you’ll learn:
1. How to run Microsoft’s Phi-3 on Windows using Ollama
a. how to use Ollama it to run Microsoft’s Phi-3 on Windows locally
b. How to Download and install Ollama
c. How to insall Ollama
d. How to Run Phi-3 command and download the LLM
e. How to download the Phi-3 model using Ollama
f. How to download Ollama models
g. How to download phi3 using command
h. How to download phi-3 on your machine
i. How to start chatting with the model locally
j. How to start chatting with Microsoft’s Phi-3 LLM
k. How to start chatting with Microsoft’s Phi-3 on Windows using your terminal app
2. How to run Microsoft’s Phi-3 on Windows using LM Studio
a. how to set up Phi-3 on LM Studio and start chatting with the model locally
b. How to Install LM Studio
c. How to download LM Studio for Windows
d. How to Download Phi-3 gguf file
e. How to get the Phi-3 guff file
f. How to find two versions of the Phi-3 model
g. How to Load the Phi-3 model
h. How to load the downloaded Phi-3 model
i. How to move the Phi-3 guff file to Local models folder
j. How to make the Phi-3 guff file appear in the LM Studio
k. How To load the Phi-3 model
l. How to start chatting with Phi-3
m. How to offload the model to the GPU so your CPU doesn’t come under undue pressure
n. How to maximize GPU Acceleration
o. How to Reload model to apply configuration
p. Start chatting with Microsoft’s Phi-3 LLM
q. How to chat with Microsoft’s Phi-3 model on your Windows PC locally without internet connection

























Song: Balynt & Lichu – Kung Fu
Music provided by Vlog No Copyright Music.
Video Link: https://bit.ly/3LmHyQ5

Song: Ikson – Merry (Vlog No Copyright Music)
Music promoted by Vlog No Copyright Music.
Video Link: https://www.youtube.com/watch?v=cd6vZCb0X_c&t=0s

Song: Mulle – Letting Go (Vlog No Copyright Music)
Music provided by Vlog No Copyright Music.
Video Link: https://www.youtube.com/watch?v=62j68FD6ows&t=0s

Song: giant cactus – deep memories
Music provided by Vlog No Copyright Music.
Video Link: https://bit.ly/3LoLIXu

#computereverywhere #howtorun #microsoft #phi3 #ai #windows #locally

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *

RackNerd Billboard Banner