Skip to content

【BUG?】About openai finetuning... #15

@Fay-why

Description

@Fay-why
Image

Thank you for your work. I have some questions regarding OpenAI's fine-tuning process and the code involved:

  1. Validation Data Impact: During the fine-tuning process, does the validation data affect the model's gradient updates, or is it solely used for monitoring/metrics (e.g., validation loss)?

  2. Test Data Clarification: In the provided figure, the test.jsonl file is passed to OpenAI as validation data. Could you please confirm whether this file represents the final test set used for evaluation? Specifically, I want to ensure that the test data is not inadvertently introduced into the training process, and whether this is an additional test file just for training.

I would greatly appreciate your clarification on these points.

Best regards,
Fay.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions