Could you share what you use to run it on a single 3090? I'd love to try it! | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		chpatrick on Jan 9, 2024 \| parent \| context \| favorite \| on: Mixtral 8x7B: A sparse Mixture of Experts language... Could you share what you use to run it on a single 3090? I'd love to try it!

coder543 on Jan 9, 2024 [–]

ollama has been by far the easiest way for me, either on Linux directly (as I do now) or WSL2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact