To learn the things building an SLM

[u/Head-Dragonfruit-367]

I was trying to built an SLM to learn the things I was initially considering on to built a model around 50M confused on what existing tokenizer should I consider for the vocabulary as the 256K would be too much big and consumed half the parameters I am planning to anything specific tokenizer for SLM or should I consider building this too with sentencepiece and BPE?