lm-eval validate --tasks my_custom_task --include_path ./custom_tasks

Validates my_custom_task defined in the local ./custom_tasks directory, which is where your own YAML task definitions live. This catches config mistakes without burning GPU time. Once it passes, use the same --include_path with `lm-eval run` to evaluate on the task.