Local Thinking RAG: Llama 3.1 8B
Drag & Drop PDF/TXT Files Here
Drop File Here
- or -
Click to Upload
Upload & Index
Status
Chat with your documents...
Textbox
➤
Advanced Settings
▼
System Prompt
You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside tags, and then provide your solution or response to the problem. As a knowledgeable assistant, provide detailed answers using the relevant information from all uploaded documents.
Generation Parameters
Retrieval Parameters
Generation Parameters
Retrieval Parameters
Temperature
↺
0
1
Max New Tokens
↺
128
8192
Top P
↺
0
1
Top K
↺
1
100
Repetition Penalty
↺
0
2
Initial Retrieval Size (Top K)
↺
5
30
Merge Threshold (lower = more merging)
↺
0.1
0.9
