{"id":4198,"date":"2024-12-13T17:19:23","date_gmt":"2024-12-13T16:19:23","guid":{"rendered":"https:\/\/tech.lobobrothers.com\/create-your-own-chatgpt\/"},"modified":"2025-02-13T16:09:05","modified_gmt":"2025-02-13T15:09:05","slug":"create-your-own-chatgpt","status":"publish","type":"post","link":"https:\/\/tech.lobobrothers.com\/en\/create-your-own-chatgpt\/","title":{"rendered":"Create your own chatgpt"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

OLLAMA Y OPEN-WEBUI<\/strong><\/h2>\n

It’s been a while since we wrote anything due to lack of time, but we have taken a moment to give you your guide to setting up a chatgpt.<\/strong><\/p>\n

To do this we will use Ollama<\/strong>, a tool to work with LLM<\/strong> language models or in other words, large language models. Together with Open-WebUI<\/strong>, an extensible artificial intelligence interface, you will have your own chatgpt<\/strong> either locally or on your own server.<\/p>\n

The installation is simple, we can use docker if we want, although in this guide it will be traditional style for those who still have difficulties with docker.<\/p>\n

We will do this installation on a Debian 12 with 6 cores and 16GB RAM and 100Gb of disk with language models that do not consume more than that. We go to our machine’s console either locally or by ssh. In our case all our laboratories, training, tutorials,…we do them in Proxmox VM.<\/p>\n

Let’s start by connecting to our Debian 12 machine for this post and running the following commands<\/p>\n

Tools needed<\/p>\n

apt-get install curl<\/p>\n

Installing Ollama<\/p>\n

curl -fsSL https:\/\/ollama.com\/install.sh | sh<\/p>\n

\"instalar<\/p>\n

Once installed, we will see that it has created the ollama.service service listening on port 11434 on localhost, which we can edit if we want it to be accessible from other hosts<\/p>\n

nano \/etc\/systemd\/system\/ollama.service<\/p>\n

having to add in the [Service] part<\/p>\n

Environment=”OLLAMA_HOST=0.0.0.0″<\/p>\n

\"configurar<\/p>\n

We reload and restart the service.<\/p>\n

systemctl daemon-reload && systemctl restart ollama.service<\/p>\n

And we check that it is listening on any interface.<\/p>\n

ss<\/a>\u00a0-napt | grep ollama<\/p>\n

\"ollama<\/p>\n

Perfect, we already have our Ollama<\/strong> installed but we need to load the models, which you can see at https:\/\/ollama.com\/search and we will load them with ollama pull model. Keep in mind that you will need a lot of disk and memory depending on the loaded models. This would be the free memory required on the server for a Meta llama, for example:<\/p>\n