Running marqo offline

General
1

I am running on an air gapped RHEL node, and I would like to try out marqo. I got pulled the original image from docker hub, and I saw it tried to download the embedding model from huggingface, so I made a new image from the marqo image that copies the model directly to /app/marqo/cache.

However, I still fail to run it because it tries to get the model information from hugginface again even though the model is cached.

Are there any flags I should be altering to use marqo in offline mode?

2

Hello @msabty . Your issue seems to be similar to what’s discussed in this thread: Where are embedding models stored? - #6 by rcking. A workaround and an explanation is provided in that thread. Could you check if it solves your problem?

Meanwhile, Marqo team will be working on a solution to fix this issue in the near future. Thanks a lot.