Note Docker container used to generate both datasets, data-generation-results & functions-filtered. * Pull it down with `docker pull registry.hf.space/muellerzr-llama-3-self-align-data-gen-docker:latest` * Run via `docker run --gpus all -it registry.hf.space/muellerzr-llama-3-self-align-data-gen-docker:latest` * From there follow the steps laid out here: https://github.com/muellerzr/llama-3-8b-self-align/tree/main?tab=readme-ov-file#data-generation-pipeline (including `seed_gathering`)

Note Contains all steps detailed in the data-generation-pipline after `seed_gathering`. Each branch pertains to one of the steps, using llama-3-8B to do the data generation via vLLM: - Snippet -> Concept (`snippet-to-concept`) - Concept -> Instruction (`concept-to-instruction`) - Instruction -> Response (`instruction-to-response`) - Execution filter (`execution-filter`) - Sanitation & Final Selection (`sanitization-and-selection` & the `main` branch)

Note Contains the results of the `seed_gathering` portion of the data generation pipeline, however using llama-3-8B as a judge

muellerzr/llama-3-8B-self-align

Updated May 9, 2024 • 3 • 1

Note Contains the `config.yaml` for `accelerate launch` and the bash script used to start training