-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
create_graph.py crashes after some time #8
Comments
#7 check this issue. |
UPD 24.07.2024: fixed the following problem (matplotlib exception) by reinstalling matplotlib. pip uninstall matplotlib
conda install matplotlib==3.7.2 Still looking for updates regarding Out Of Memory issue. Thanks. I hadn't Out of memory crash this time, but faced the following exception: -- removing small and empty masks --
number of masked pcds: 1202
number of mask_feats: 1202
masked pcds saved to disk in data/scene_graphs_new/00824-Dd4bFSTQ8gi/hm3dsem/00824-Dd4bFSTQ8gi
full pcd saved to disk in data/scene_graphs_new/00824-Dd4bFSTQ8gi/hm3dsem/00824-Dd4bFSTQ8gi
full pcd feats saved to disk in data/scene_graphs_new/00824-Dd4bFSTQ8gi/hm3dsem/00824-Dd4bFSTQ8gi
hm3dsem
segmenting floors...
downpcd (294355, 3)
bins 281.20046911000327
distance 20.0
1047.017793594306
min_peak_height 1490.0
clustred_peaks [0.00603302 2.43776661]
floors [[0.006033019964371361, 2.4377666140473178]]
number of floors: 1
segmenting rooms...
grid_size: 0.05
occupancy_map shape: (340, 340)
range of dist: 0.0 48.0
Error executing job with overrides: ['main.dataset=hm3dsem', 'main.dataset_path=data/hm3dsem_walks_new/val/00824-Dd4bFSTQ8gi/', 'main.save_path=data/scene_graphs_new/00824-Dd4bFSTQ8gi']
Traceback (most recent call last):
File "/home/ncdev/repos/HOV-SG/application/create_graph.py", line 34, in main
hovsg.build_graph(save_path=save_dir)
File "/home/ncdev/repos/HOV-SG/hovsg/graph/graph.py", line 814, in build_graph
self.segment_rooms(floor, save_path)
File "/home/ncdev/repos/HOV-SG/hovsg/graph/graph.py", line 489, in segment_rooms
room_vertices = distance_transform(full_map, resolution, tmp_floor_path)
File "/home/ncdev/repos/HOV-SG/hovsg/utils/graph_utils.py", line 236, in distance_transform
plt.figure()
File "/home/ncdev/miniforge3/envs/hovsg/lib/python3.9/site-packages/matplotlib/pyplot.py", line 1027, in figure
manager = new_figure_manager(
File "/home/ncdev/miniforge3/envs/hovsg/lib/python3.9/site-packages/matplotlib/pyplot.py", line 550, in new_figure_manager
return _get_backend_mod().new_figure_manager(*args, **kwargs)
File "/home/ncdev/miniforge3/envs/hovsg/lib/python3.9/site-packages/matplotlib/backend_bases.py", line 3507, in new_figure_manager
return cls.new_figure_manager_given_figure(num, fig)
File "/home/ncdev/miniforge3/envs/hovsg/lib/python3.9/site-packages/matplotlib/backend_bases.py", line 3512, in new_figure_manager_given_figure
return cls.FigureCanvas.new_manager(figure, num)
File "/home/ncdev/miniforge3/envs/hovsg/lib/python3.9/site-packages/matplotlib/backend_bases.py", line 1797, in new_manager
return cls.manager_class.create_with_canvas(cls, figure, num)
File "/home/ncdev/miniforge3/envs/hovsg/lib/python3.9/site-packages/matplotlib/backends/_backend_tk.py", line 504, in create_with_canvas
manager = cls(canvas, num, window)
File "/home/ncdev/miniforge3/envs/hovsg/lib/python3.9/site-packages/matplotlib/backends/_backend_tk.py", line 457, in __init__
super().__init__(canvas, num)
File "/home/ncdev/miniforge3/envs/hovsg/lib/python3.9/site-packages/matplotlib/backend_bases.py", line 2655, in __init__
self.toolbar = self._toolbar2_class(self.canvas)
File "/home/ncdev/miniforge3/envs/hovsg/lib/python3.9/site-packages/matplotlib/backends/_backend_tk.py", line 649, in __init__
NavigationToolbar2.__init__(self, canvas)
File "/home/ncdev/miniforge3/envs/hovsg/lib/python3.9/site-packages/matplotlib/backend_bases.py", line 2850, in __init__
self._nav_stack = cbook._Stack()
File "/home/ncdev/miniforge3/envs/hovsg/lib/python3.9/site-packages/matplotlib/_api/__init__.py", line 217, in __getattr__
raise AttributeError(
AttributeError: module 'matplotlib.cbook' has no attribute '_Stack'
Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.
|
Hi! I encountered the same issue with the process being killed during the merging of 3D masks. Will reinstalling Matplotlib solve this problem? Additionally, could you let me know which tool you used for tracing the executable? Was it perf?
|
@Eku127, what you are seeing is most likely an "Out of Memory" problem. You can use workaround by changing "merge_type" to "hierarchical" in the config. See this comment from the contributor for more details: #8 (comment). Reinstalling matplotlib won't help with this particular problem. It fixes a different bug in the system. So, there's no need to reinstall matplotlib unless you encounter the "AttributeError: module 'matplotlib.cbook' has no attribute '_Stack'" exception. |
Got it. All I need is more RAM 🤣 However, I think there's still a lot of work needed to optimize RAM usage. |
However, when I am trying to generate scene graph, I repeatedly face crashes:
Traces show that some processes were killed on my machine, due to
Out of memory
problem. Despite the machine having 62 gigs of RAM.What are the memory requirements for this script to run properly?
Originally posted by @ADetilie in #6 (comment)
The text was updated successfully, but these errors were encountered: