Fixed the issue by following this thread https://huggingface.co/proxy/discuss.huggingface.co/t/loading-peft-model-from-checkpoint-leading-into-size-missmatch/71944