peng
superpeng
·
AI & ML interests
None yet
Recent Activity
liked a dataset about 1 month ago
TaurenMountain/Speechio-Formal upvoted a paper 4 months ago
AWorld: Orchestrating the Training Recipe for Agentic AI upvoted a collection 4 months ago
ReasoningOrganizations
None yet
LLM Fine-Tune
-
BitDelta: Your Fine-Tune May Only Be Worth One Bit
Paper • 2402.10193 • Published • 21 -
StructLM: Towards Building Generalist Models for Structured Knowledge Grounding
Paper • 2402.16671 • Published • 27 -
LoRA Learns Less and Forgets Less
Paper • 2405.09673 • Published • 91 -
NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models
Paper • 2405.17428 • Published • 21
LLM evlaue
LLM Pretrain
-
How to Train Data-Efficient LLMs
Paper • 2402.09668 • Published • 43 -
Adapting Large Language Models via Reading Comprehension
Paper • 2309.09530 • Published • 82 -
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper • 2403.03507 • Published • 192 -
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Paper • 2403.02884 • Published • 17
RAG
LLM Depoly
reward
LLM Pretrain
-
How to Train Data-Efficient LLMs
Paper • 2402.09668 • Published • 43 -
Adapting Large Language Models via Reading Comprehension
Paper • 2309.09530 • Published • 82 -
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper • 2403.03507 • Published • 192 -
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Paper • 2403.02884 • Published • 17
LLM Fine-Tune
-
BitDelta: Your Fine-Tune May Only Be Worth One Bit
Paper • 2402.10193 • Published • 21 -
StructLM: Towards Building Generalist Models for Structured Knowledge Grounding
Paper • 2402.16671 • Published • 27 -
LoRA Learns Less and Forgets Less
Paper • 2405.09673 • Published • 91 -
NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models
Paper • 2405.17428 • Published • 21
RAG
LLM evlaue
LLM Depoly