Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training datasets #11

Open
andrewjjung47 opened this issue May 20, 2022 · 11 comments
Open

Training datasets #11

andrewjjung47 opened this issue May 20, 2022 · 11 comments

Comments

@andrewjjung47
Copy link

Hello,

I am wondering if the training datasets used in the publication (RNAStralign, TR0, and fine-tuning dataset for bpRNA-new) are available? I was able to find the evaluation datasets from Google Drive (https://drive.google.com/drive/folders/143TJDgGqYOhumayiDx7w4XWLDVEOSZ2X) but do not see the training sets.

Also, I am wondering which datasets were used to train ufold_train.pt and ufold_train_alldata.pt?

Thank you so much in advance!

@sperfu
Copy link
Contributor

sperfu commented May 24, 2022

Hi there,

The training dataset we used in the publication can be retrieved from mxfold2 paper(RNAStralign and TR0), you can download that data from its repository, as for the fine-tuning dataset for bpRNA-new, we kept the fasta file after mutating and CD-Hit. You can download that from the google drive link.

As for the ufold_train.pt and ufold_train_alldata.pt, the difference between these two files is the training data. We use all the data including training and testing datasets to train the latter model for future prediction on other sequences. And we also kept the pre-trained model only for training (ufold_train.pt).

Thanks.

@andrewjjung47
Copy link
Author

Thank you for your response!

@andrewjjung47
Copy link
Author

Hello there, I have another quick question regarding exactly which datasets were used to train ufold_train.pt.

Was it trained only on TR0 or RNAStralign & TR0? Also, was the provided ufold_train.pt also trained on the fine-tuning dataset for bpRNA-new?

@andrewjjung47 andrewjjung47 reopened this Jun 7, 2022
@CatIIIIIIII
Copy link

Hello there, I have another quick question regarding exactly which datasets were used to train ufold_train.pt.

Was it trained only on TR0 or RNAStralign & TR0? Also, was the provided ufold_train.pt also trained on the fine-tuning dataset for bpRNA-new?

Same question

@CatIIIIIIII
Copy link

Hello there, I have another quick question regarding exactly which datasets were used to train ufold_train.pt.

Was it trained only on TR0 or RNAStralign & TR0? Also, was the provided ufold_train.pt also trained on the fine-tuning dataset for bpRNA-new?

I doubt that the author mistoke testing data for training since I can only reach up to 0.5 F1s with TR0 for training and TS0 for testing under same settings with this repo

@sperfu
Copy link
Contributor

sperfu commented Oct 20, 2022

Hi there,

As illustrated in our paper, we trained the model on TR0 & RNAStralign & augmented mutated dataset for ufold_train.pt. TS0 is only used for training(the dataset we used is the same as MXfold2 and SPOTRNA). So we don't think we mistoke testing data for training. And ufold_train.pt is not trained on the fine-tuning dataset for bpRNA-new dataset, it is designed for fine-tuning for PDB dataset.

Thanks

@CatIIIIIIII
Copy link

Hi there,

As illustrated in our paper, we trained the model on TR0 & RNAStralign & augmented mutated dataset for ufold_train.pt. TS0 is only used for training(the dataset we used is the same as MXfold2 and SPOTRNA). So we don't think we mistoke testing data for training. And ufold_train.pt is not trained on the fine-tuning dataset for bpRNA-new dataset, it is designed for fine-tuning for PDB dataset.

Thanks

Hello,

Thank you for your response. Maybe I need to set training epoches larger for better results.

@CatIIIIIIII
Copy link

Hi there,

As illustrated in our paper, we trained the model on TR0 & RNAStralign & augmented mutated dataset for ufold_train.pt. TS0 is only used for training(the dataset we used is the same as MXfold2 and SPOTRNA). So we don't think we mistoke testing data for training. And ufold_train.pt is not trained on the fine-tuning dataset for bpRNA-new dataset, it is designed for fine-tuning for PDB dataset.

Thanks

Hi,

Could you share your augmented mutated dataset pickle file?

@black0017
Copy link

Hi all @CatIIIIIIII @sperfu @andrewjjung47 !

I would like to ask if it's possible to share with us the mutated sequence of bpRNA-new that you generated (synthetic/augmented data).

That would be very helpful!

Thanks in advance.
N.

@black0017
Copy link

@CatIIIIIIII @sperfu @andrewjjung47

The PDB train set (669 structures), as detailed in the supplementary material, would be very helpful if you could indicate which file/folder it corresponds to.

image

@black0017
Copy link

black0017 commented Jun 9, 2023

@CatIIIIIIII @sperfu @andrewjjung47
Update:

PDB train data

hi, I have found the 669 PDB files here: https://bprna.cgrb.oregonstate.edu/index.html
Nonetheless, the .fasta files are just the sequences, there are no contact maps.

Mutated data

merge_allbpnew_mutate.cdhit.fa probably contains the mutated sequences but the targets (contact maps) are again missing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants