Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Assignment large number of matrices at the same time consumes too much memory #544

Open
pedrocamargo opened this issue Jun 21, 2024 · 3 comments
Assignees

Comments

@pedrocamargo
Copy link
Contributor

When trying to assign many large matrices at the same time (225 x 11,700, 11,700) requires an excessive amount of memory (~230Gb).

There is no reason why we would not allow users to provide matrices in 32-bit and convert them only when feeding into the compiled code.

@Art-Ev
Copy link
Contributor

Art-Ev commented Jul 10, 2024

@pedrocamargo, @Jake-Moss : coud this "problem" result in this kind of message ? (graph computation of only one 955 x 955 matrix on a 64 760 links network)
image

@Art-Ev
Copy link
Contributor

Art-Ev commented Jul 10, 2024

Same result with a 21x21 matrix on the same network :'( will investigate with another method

@pedrocamargo
Copy link
Contributor Author

The problem here is a different one, @Art-Ev . I would guess that your problem here is that your link IDs are way too large. Are they as large as 2090000960?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants