Tools for thought - Ship's Log 5 - Building

permalink

This one is a shorter post as a note to self for locally running models.

The default behavior for sentence_transformers is to download a model from HuggingFace

To make the model run locally:

``` mkdir local_models/all-MiniLM-L6-v2/

pip install huggingface_hub hf download sentence-transformers/all-MiniLM-L6-v2 --local-dir local_models/all-MiniLM-L6-v2/ ```

Then in code:

python MODEL = SentenceTransformer("sentence-transformers/all-MiniLM-L6-v2")

Becomes

python MODEL = SentenceTransformer("local_models/all-MiniLM-L6-v2", local_files_only=True)

Documentation for SentenceTransformer