Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to reproduce paper metrics, questions about paper results #23

Open
wjaycyf opened this issue Oct 25, 2024 · 1 comment
Open

Unable to reproduce paper metrics, questions about paper results #23

wjaycyf opened this issue Oct 25, 2024 · 1 comment

Comments

@wjaycyf
Copy link

wjaycyf commented Oct 25, 2024

Hi, I downloaded the train_blur_bicubic and val_blur_bicubic datasets of type Blur + Low Resolution according to the dataset link you provided,
image
Next, I run . /preprocessing/generate_reds4.py and . /preprocessing/generate_flow.py, which generated the corresponding reds4 validation set and the corresponding optical flow file as follows,
image
Using the above files as a test set, gt is the corresponding files taken from the dataset links train_orig_part0.zip and train_orig_part1.zip.
Next, I run python main.py --test --config_path experiment.cfg with the provided pre-training weights and the accuracy results of the test are as follows,
image
image
image
The results are quite different from the results of your paper, may I ask which type of data from REDS did you use for the experiment? If I want to reproduce the results of your paper, which type of dataset do I need to download? Looking forward to your reply.

@GeunhyukYouk
Copy link
Collaborator

Hello,
It seems that you have downloaded the wrong GT data.
The GT data should be train_sharp and val_sharp, not train_origin. Please refer to the image below.
image

Also, generate_flow.py is required only for generating pseudo-GT optical flow used in training, so it is not necessary when testing with the provided pretrained model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants