The following commands help to export/backup the ollama models which allows to quick restore the models or setup an offline machine using file transfer. Pull a model from registry ollama pull llava:7b Export the model mkdir -p llava_7b_backup cd llava_7b_backup ollama show --modelfile llava:7b > Modelfile cat Modelfile | grep -E '^FROM' | cut -d ' ' -f 2 | xargs -I {} cp {} . cat Modelfile | grep '# FROM' | cut -d ' ' -f 3 | xargs -I {} echo 'ollama create {} -f Modelfile' > readme.txt sed -i '' -E 's/^FROM.*blobs/FROM ./g' Modelfile Import the model cd llava_7b_backup ollama create llava:7b -f Modelfile Run the model ollama run llava:7b Remove the model ollama rm llava:7b
This article explains step by step guide to download an AI model from Hugging Face repository and run it with Ollama. Ollama allows to create a model locally from GGUF format or SafeTensors format and this article will cover both models. Creating from GGUF models is highly reliable as the GGUF file is packaged with model data with template file suitable for the AI model. Running a model using GGUF: Example repository with GGUF formal model https://huggingface.co/sergbese/gemma-3-isv-translator-v5-gguf-bf16 Create a download directory: mkdir gemma-3-isv-translator-v5-gguf-bf16 Download the file into the directory cd gemma-3-isv-translator-v5-gguf-bf16 wget "https://huggingface.co/sergbese/gemma-3-isv-translator-v5-gguf-bf16/resolve/main/gemma-3-finetune-2.BF16.gguf?download=true" -O ./gemma-3-finetune-2.BF16.gguf Create an Ollama model: echo 'FROM ./gemma-3-finetune-2.BF16.gguf' > Modelfile ollama create gemma-3-isv-translator-v5-gguf-bf16:latest Run and verify the ...
This blog is a step by step guide on how to run a Windows Virtual Machine on MacOS using UTM (Open Source Virtual Machine Tool). Also the settings needed to share Clipboard and Directory between Windows and MacOS. Download and Install UTM application on MacOS from https://mac.getutm.app/ Download Windows 11 iso file from Microsoft https://www.microsoft.com/en-us/software-download/windows11 Download Windows Guest tool iso file https://getutm.app/downloads/utm-guest-tools-latest.iso Steps to create Windows 11 Virtual Machine Click Create a New Virtual Machine Click Virtualize Select Windows Set memory as 12288 MiB Set CPU Cores as 3 Click Continue Tick Install Windows 10 or higher Click Browse and select Windows 11 iso file Tick Install drivers and SPICE tools Click Continue Set size at 64 GiB Click Continue Do not set Shared Directory Path now, we can do it after installation Click Continue Set Name as Windows Click Save Steps to install Windows 11 Click on Windows In first CD/DVD, sele...
Comments
Post a Comment