Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Validate baseline PPHC ability to approximate underlying DECA coordinates system #79

Open
4 tasks done
profgrumpy opened this issue Jun 21, 2022 · 3 comments
Open
4 tasks done
Assignees
Labels
Experiments Work necessary to perform experiments

Comments

@profgrumpy
Copy link
Collaborator

profgrumpy commented Jun 21, 2022

  • Finish code to simulate student interactions based on a DECA coordinate system.
  • run experiment on simulated student interaction data to ensure that PPHC is able to approximate the underlying DECA coordinate system.
  • Update overleaf paper accordingly
  • Make sure to emphasize the differences in our implementations vis-a-vis the original algorithm; e.g., mutations, other implementation specifics since the code reformulates the algorithm a bit.
@profgrumpy profgrumpy added this to the EvoPIE mark 1.2 milestone Jun 21, 2022
@profgrumpy profgrumpy added the Experiments Work necessary to perform experiments label Jun 21, 2022
dvitel added a commit that referenced this issue Jun 29, 2022
@dvitel
Copy link
Contributor

dvitel commented Jun 29, 2022

First version of synth_deca_axes, synth_deca_spanned was committed. TBD mapping of dimensions to StudentKnowledge

dvitel added a commit that referenced this issue Jun 29, 2022
dvitel added a commit that referenced this issue Jun 30, 2022
dvitel added a commit that referenced this issue Aug 17, 2022
@dvitel
Copy link
Contributor

dvitel commented Aug 17, 2022

I am closing this issue for now. Experiment was done and paper is on overleaf. We could create separate tickets for other experiments.

@dvitel dvitel closed this as completed Aug 17, 2022
dvitel added a commit that referenced this issue Feb 13, 2023
@dvitel dvitel reopened this Feb 17, 2023
@dvitel
Copy link
Contributor

dvitel commented Feb 17, 2023

Experimentation of PPHC with slightly changed behavior on Pareto non-dominance did not give better results than initial PPHC.
The idea was to move from strategy of leaving parent on non-dominance to strategy of leaving least evaluated individual (basically child). The results are similar: PPHC-1-2-1-3 is not better/slightly better that RAND-3 and worse than RAND-5. Changes are possibly statistically insignificant.
Conclusion: we need to go to different schema how algorithm could "move" towards best knowledge discovery. I reopen this ticket to continue the experimentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Experiments Work necessary to perform experiments
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

2 participants