Are these variables implicitly read by transformers library or do I need to incorporate into generate function?
#6
by
boydcheung
- opened
export greedy='false'
export top_p=0.8
export top_k=20
export temperature=0.7
export repetition_penalty=1.0
export presence_penalty=1.5
export out_seq_length=16384