lucidia/lucidia-main
9
1
Fork 0
mirror of https://github.com/blackboxprogramming/lucidia.git synced 2026-03-17 09:37:56 -05:00
Code Issues Packages Projects Releases Wiki Activity

Add configs/model.yaml with model configuration

Browse Source
This commit is contained in:
blackboxprogramming
2025-08-08 01:03:27 -07:00
committed by GitHub
parent efa5c44869
commit 52bb6de309
1 changed files with 9 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
lucidia_llm/configs/model.yaml Normal file
View File

@@ -0,0 +1,9 @@
# Configuration for Lucidia offline language model
model:
d_model: 4096
n_layers: 32
n_heads: 32
d_ff: 16384
max_position_embeddings: 2048
dropout: 0.1
vocab_size: 50000