Spaces:

afeng
/

tokenizers

Running

App Files Files Community

tokenizers / requirements.txt

afeng's picture

add tokenizer

af99c46 about 1 month ago

history blame contribute delete

145 Bytes

	gradio==4.44.1
	transformers==4.46.0
	torch==2.5.0
	sentencepiece==0.2.0
	protobuf==5.28.2
	tokenizers==0.20.1
	huggingface-hub==0.26.0
	tiktoken==0.8.0