LLM Model Setup

What is the role of the LLM model?

It helps you organize answers to your questions and provide better analysis results.

LLM Model Types

1. Cloud: Cloud means using third-party cloud services to access LLM capabilities (providing better analysis results).

2. Local: Local means using only your device to access LLM capabilities (providing absolute privacy).

   Reminder: Please note the model size; the larger the model, the better the performance, but it also consumes more computer resources (7B > 3B). Based on tests, the 3B model meets basic needs.

How to set it?

1. Hover the "S" button in the upper right corner.
2. Click "LLM Model".
3. choose the model you want.