lucidia/lucidia-main
9
1
Fork 0
mirror of https://github.com/blackboxprogramming/lucidia.git synced 2026-03-17 05:57:21 -05:00
Code Issues Packages Projects Releases Wiki Activity

Add tokenizer/spm.yaml with SentencePiece configuration

Browse Source
This commit is contained in:
blackboxprogramming
2025-08-08 01:14:25 -07:00
committed by GitHub
parent b665b0dc19
commit 91fb34569e
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
lucidia_llm/tokenizer/spm.yaml Normal file
View File

@@ -0,0 +1,3 @@
# SentencePiece model configuration for Lucidia
model_type: bpe
vocab_size: 50000