Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[bitnami/rabbitmq] unable to start rabbitmq docker container after 3.13 #71378

Closed
chengjie8 opened this issue Aug 27, 2024 · 8 comments
Closed

[bitnami/rabbitmq] unable to start rabbitmq docker container after 3.13 #71378

chengjie8 opened this issue Aug 27, 2024 · 8 comments
Assignees
@jotamartos
Labels
rabbitmq solved tech-issues The user has a technical issue about an application

Comments

@chengjie8
Copy link

chengjie8 commented Aug 27, 2024 •
edited
Loading

Name and Version

bitnami/rabbitmq:3.13

What architecture are you using?

None

What steps will reproduce the bug?

  1. docker pull bitnami/rabbitmq:3.13
  2. docker run -d --name rabbitmq-server-2 -p 15672:15672 -p 5672:5672 \ -e RABBITMQ_LOGS=- \ -e RABBITMQ_LOG_LEVEL=debug \ bitnami/rabbitmq:3.13

What is the expected behavior?

rabbitmq container starts and no issue

What do you see instead?

2024-08-27 12:39:20 rabbitmq 16:39:20.39 INFO  ==> Welcome to the Bitnami rabbitmq container
2024-08-27 12:39:20 rabbitmq 16:39:20.41 INFO  ==> Subscribe to project updates by watching https://github.com/bitnami/containers
2024-08-27 12:39:20 rabbitmq 16:39:20.43 INFO  ==> Submit issues and feature requests at https://github.com/bitnami/containers/issues
2024-08-27 12:39:20 rabbitmq 16:39:20.46 INFO  ==> Upgrade to Tanzu Application Catalog for production environments to access custom-configured and pre-packaged software components. Gain enhanced features, including Software Bill of Materials (SBOM), CVE scan result reports, and VEX documents. To learn more, visit https://bitnami.com/enterprise
2024-08-27 12:39:20 rabbitmq 16:39:20.48 INFO  ==> 
2024-08-27 12:39:20 rabbitmq 16:39:20.54 INFO  ==> ** Starting RabbitMQ setup **
2024-08-27 12:39:20 rabbitmq 16:39:20.66 INFO  ==> Validating settings in RABBITMQ_* env vars..
2024-08-27 12:39:20 rabbitmq 16:39:20.86 INFO  ==> Initializing RabbitMQ...
2024-08-27 12:39:21 rabbitmq 16:39:21.03 INFO  ==> Generating random cookie
2024-08-27 12:39:21 rabbitmq 16:39:21.22 INFO  ==> Starting RabbitMQ in background...
2024-08-27 12:41:42 rabbitmq 16:41:42.70 ERROR ==> Couldn't start RabbitMQ in background.

then the container shuts down

Additional information

  • I had no issues starting 3.12 containers with the same Docker command. Now, I am encountering the same behavior and issues with all 3.13 images (e.g., 3.13, 3.13.6, and 3.13-debian-12).
  • I use an M1 Mac, if that matters.
@chengjie8 chengjie8 added the tech-issues The user has a technical issue about an application label Aug 27, 2024
@github-actions github-actions bot added the triage Triage is needed label Aug 27, 2024
@chengjie8 chengjie8 mentioned this issue Aug 27, 2024
Closed
@javsalgar javsalgar changed the title unable to start rabbitmq docker container after 3.13 [bitnami/rabbitmq] unable to start rabbitmq docker container after 3.13 Aug 28, 2024
@javsalgar
Copy link
Contributor

Hi!

Could you launch the container with BITNAMI_DEBUG=true?

@chengjie8
Copy link
Author

@javsalgar I have added that. The container starts now but with boot failure message, do you know how to resolve the issue?

2024-08-29 10:24:28 rabbitmq 14:24:28.46 INFO  ==> 
2024-08-29 10:24:28 rabbitmq 14:24:28.50 INFO  ==> Welcome to the Bitnami rabbitmq container
2024-08-29 10:24:28 rabbitmq 14:24:28.53 INFO  ==> Subscribe to project updates by watching https://github.com/bitnami/containers
2024-08-29 10:24:28 rabbitmq 14:24:28.55 INFO  ==> Submit issues and feature requests at https://github.com/bitnami/containers/issues
2024-08-29 10:24:28 rabbitmq 14:24:28.58 INFO  ==> Upgrade to Tanzu Application Catalog for production environments to access custom-configured and pre-packaged software components. Gain enhanced features, including Software Bill of Materials (SBOM), CVE scan result reports, and VEX documents. To learn more, visit https://bitnami.com/enterprise
2024-08-29 10:24:28 rabbitmq 14:24:28.61 INFO  ==> 
2024-08-29 10:24:28 rabbitmq 14:24:28.68 INFO  ==> ** Starting RabbitMQ setup **
2024-08-29 10:24:28 rabbitmq 14:24:28.84 INFO  ==> Validating settings in RABBITMQ_* env vars..
2024-08-29 10:24:29 rabbitmq 14:24:29.09 INFO  ==> Initializing RabbitMQ...
2024-08-29 10:24:29 rabbitmq 14:24:29.14 DEBUG ==> Creating configuration file...
2024-08-29 10:24:29 rabbitmq 14:24:29.24 DEBUG ==> Creating environment file...
2024-08-29 10:24:29 rabbitmq 14:24:29.28 DEBUG ==> Creating enabled_plugins file...
2024-08-29 10:24:29 rabbitmq 14:24:29.38 DEBUG ==> Creating Erlang cookie...
2024-08-29 10:24:29 rabbitmq 14:24:29.41 INFO  ==> Generating random cookie
2024-08-29 10:24:29 rabbitmq 14:24:29.51 DEBUG ==> Ensuring expected directories/files exist...
2024-08-29 10:24:29 rabbitmq 14:24:29.67 INFO  ==> Starting RabbitMQ in background...
2024-08-29 10:24:34 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:24:36 Waiting for applications 'rabbit_and_plugins' to start on node 'rabbit@localhost'
2024-08-29 10:24:41 2024-08-29 14:24:41.093871+00:00 [notice] <0.44.0> Application syslog exited with reason: stopped
2024-08-29 10:24:41 2024-08-29 14:24:41.117063+00:00 [notice] <0.254.0> Logging: switching to configured handler(s); following messages may not be visible in this log output
2024-08-29 10:24:41 2024-08-29 14:24:41.123405+00:00 [notice] <0.254.0> Logging: configured log handlers are now ACTIVE
2024-08-29 10:24:41 2024-08-29 14:24:41.151214+00:00 [info] <0.254.0> ra: starting system quorum_queues
2024-08-29 10:24:41 2024-08-29 14:24:41.151898+00:00 [info] <0.254.0> starting Ra system: quorum_queues in directory: /bitnami/rabbitmq/mnesia/rabbit@localhost/quorum/rabbit@localhost
2024-08-29 10:24:41 2024-08-29 14:24:41.360285+00:00 [info] <0.315.0> ra system 'quorum_queues' running pre init for 0 registered servers
2024-08-29 10:24:41 2024-08-29 14:24:41.390839+00:00 [info] <0.316.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered
2024-08-29 10:24:41 2024-08-29 14:24:41.434190+00:00 [notice] <0.321.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables
2024-08-29 10:24:41 2024-08-29 14:24:41.474609+00:00 [info] <0.254.0> ra: starting system coordination
2024-08-29 10:24:41 2024-08-29 14:24:41.475035+00:00 [info] <0.254.0> starting Ra system: coordination in directory: /bitnami/rabbitmq/mnesia/rabbit@localhost/coordination/rabbit@localhost
2024-08-29 10:24:41 2024-08-29 14:24:41.479449+00:00 [info] <0.330.0> ra system 'coordination' running pre init for 0 registered servers
2024-08-29 10:24:41 2024-08-29 14:24:41.482188+00:00 [info] <0.331.0> ra: meta data store initialised for system coordination. 0 record(s) recovered
2024-08-29 10:24:41 2024-08-29 14:24:41.483192+00:00 [notice] <0.336.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables
2024-08-29 10:24:41 2024-08-29 14:24:41.487308+00:00 [info] <0.254.0> ra: starting system coordination
2024-08-29 10:24:41 2024-08-29 14:24:41.487534+00:00 [info] <0.254.0> starting Ra system: coordination in directory: /bitnami/rabbitmq/mnesia/rabbit@localhost/coordination/rabbit@localhost
2024-08-29 10:24:41 2024-08-29 14:24:41.794223+00:00 [info] <0.254.0> Waiting for Khepri leader for 30000 ms, 9 retries left
2024-08-29 10:24:41 2024-08-29 14:24:41.809354+00:00 [notice] <0.341.0> RabbitMQ metadata store: candidate -> leader in term: 1 machine version: 1
2024-08-29 10:24:41 2024-08-29 14:24:41.857264+00:00 [info] <0.254.0> Khepri leader elected
2024-08-29 10:24:41 2024-08-29 14:24:41.857844+00:00 [info] <0.254.0> Waiting for Khepri projections for 30000 ms, 9 retries left
2024-08-29 10:24:42 2024-08-29 14:24:42.827287+00:00 [info] <0.254.0> 
2024-08-29 10:24:42 2024-08-29 14:24:42.827287+00:00 [info] <0.254.0>  Starting RabbitMQ 3.13.7 on Erlang 26.2.5 [jit]
2024-08-29 10:24:42 2024-08-29 14:24:42.827287+00:00 [info] <0.254.0>  Copyright (c) 2007-2024 Broadcom Inc and/or its subsidiaries
2024-08-29 10:24:42 2024-08-29 14:24:42.827287+00:00 [info] <0.254.0>  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2024-08-29 10:24:42 
2024-08-29 10:24:42   ##  ##      RabbitMQ 3.13.7
2024-08-29 10:24:42   ##  ##
2024-08-29 10:24:42   ##########  Copyright (c) 2007-2024 Broadcom Inc and/or its subsidiaries
2024-08-29 10:24:42   ######  ##
2024-08-29 10:24:42   ##########  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2024-08-29 10:24:42 
2024-08-29 10:24:42   Erlang:      26.2.5 [jit]
2024-08-29 10:24:42   TLS Library: OpenSSL - OpenSSL 3.0.13 30 Jan 2024
2024-08-29 10:24:42   Release series support status: see https://www.rabbitmq.com/release-information
2024-08-29 10:24:42 
2024-08-29 10:24:42   Doc guides:  https://www.rabbitmq.com/docs
2024-08-29 10:24:42   Support:     https://www.rabbitmq.com/docs/contact
2024-08-29 10:24:42   Tutorials:   https://www.rabbitmq.com/tutorials
2024-08-29 10:24:42   Monitoring:  https://www.rabbitmq.com/docs/monitoring
2024-08-29 10:24:42   Upgrading:   https://www.rabbitmq.com/docs/upgrade
2024-08-29 10:24:42 
2024-08-29 10:24:42   Logs: <stdout>
2024-08-29 10:24:42 
2024-08-29 10:24:42   Config file(s): /opt/bitnami/rabbitmq/etc/rabbitmq/rabbitmq.conf
2024-08-29 10:24:42 
2024-08-29 10:24:42   Starting broker...2024-08-29 14:24:42.834578+00:00 [info] <0.254.0> 
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  node           : rabbit@localhost
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  home dir       : /opt/bitnami/rabbitmq/.rabbitmq
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  config file(s) : /opt/bitnami/rabbitmq/etc/rabbitmq/rabbitmq.conf
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  cookie hash    : gID1/5+ssog1IS01pytRbw==
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  log(s)         : <stdout>
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  data dir       : /bitnami/rabbitmq/mnesia/rabbit@localhost
2024-08-29 10:24:44 2024-08-29 14:24:44.015628+00:00 [info] <0.254.0> Running boot step pre_boot defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.016269+00:00 [info] <0.254.0> Running boot step rabbit_global_counters defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.018867+00:00 [info] <0.254.0> Running boot step rabbit_osiris_metrics defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.019897+00:00 [info] <0.254.0> Running boot step rabbit_core_metrics defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.021555+00:00 [info] <0.254.0> Running boot step rabbit_alarm defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.114110+00:00 [info] <0.402.0> Memory high watermark set to 6394 MiB (6705266688 bytes) of 15986 MiB (16763166720 bytes) total
2024-08-29 10:24:44 2024-08-29 14:24:44.170735+00:00 [info] <0.404.0> Enabling free disk space monitoring (disk free space: 33641304064, total memory: 16763166720)
2024-08-29 10:24:44 2024-08-29 14:24:44.172739+00:00 [info] <0.404.0> Disk free limit set to 16763MB
2024-08-29 10:24:44 2024-08-29 14:24:44.208479+00:00 [info] <0.254.0> Running boot step code_server_cache defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.209153+00:00 [info] <0.254.0> Running boot step file_handle_cache defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.230396+00:00 [info] <0.408.0> Limiting to approx 1048479 file handles (943629 sockets)
2024-08-29 10:24:44 2024-08-29 14:24:44.232305+00:00 [info] <0.409.0> FHC read buffering: OFF
2024-08-29 10:24:44 2024-08-29 14:24:44.232601+00:00 [info] <0.409.0> FHC write buffering: ON
2024-08-29 10:24:44 2024-08-29 14:24:44.238829+00:00 [info] <0.254.0> Running boot step worker_pool defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.240032+00:00 [info] <0.376.0> Will use 5 processes for default worker pool
2024-08-29 10:24:44 2024-08-29 14:24:44.240453+00:00 [info] <0.376.0> Starting worker pool 'worker_pool' with 5 processes in it
2024-08-29 10:24:44 2024-08-29 14:24:44.245003+00:00 [info] <0.254.0> Running boot step database defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.248272+00:00 [info] <0.254.0> Peer discovery: configured backend: rabbit_peer_discovery_classic_config
2024-08-29 10:24:44 2024-08-29 14:24:44.252509+00:00 [notice] <0.377.0> Feature flags: attempt to enable `detailed_queues_endpoint`...
2024-08-29 10:24:44 2024-08-29 14:24:44.883266+00:00 [notice] <0.377.0> Feature flags: `detailed_queues_endpoint` enabled
2024-08-29 10:24:44 2024-08-29 14:24:44.884117+00:00 [notice] <0.377.0> Feature flags: attempt to enable `quorum_queue_non_voters`...
2024-08-29 10:24:45 2024-08-29 14:24:45.515363+00:00 [notice] <0.377.0> Feature flags: `quorum_queue_non_voters` enabled
2024-08-29 10:24:45 2024-08-29 14:24:45.516277+00:00 [notice] <0.377.0> Feature flags: attempt to enable `stream_update_config_command`...
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags: error while running:
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:   rabbit_feature_flags:mark_as_enabled_locally[stream_update_config_command,
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0>                                                               state_changing]
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags: on node `rabbit@localhost`:
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:   exception error: {exception,
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                        {badmap,rabbitmq_management},
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                        [{maps,filter,
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                             [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                              rabbitmq_management],
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                             [{file,"maps.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                              {line,611},
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                              {error_info,#{module => erl_stdlib_errors}}]},
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                         {rabbit_feature_flags,mark_as_enabled_locally,2,
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                             [{file,"rabbit_feature_flags.erl"},{line,1202}]}]}
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:     in function  erpc:call/5 (erpc.erl, line 702)
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:     in call from rabbit_ff_controller:rpc_call/5 (rabbit_ff_controller.erl, line 1384)
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:     in call from rabbit_ff_controller:'-rpc_calls/5-fun-1-'/7 (rabbit_ff_controller.erl, line 1416)
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> 
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags: error while running:
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:   rabbit_feature_flags:mark_as_enabled_locally[stream_update_config_command,
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0>                                                               false]
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags: on node `rabbit@localhost`:
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:   exception error: {exception,
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                        {badmap,rabbitmq_management},
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                        [{maps,filter,
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                             [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                              rabbitmq_management],
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                             [{file,"maps.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                              {line,611},
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                              {error_info,#{module => erl_stdlib_errors}}]},
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                         {rabbit_feature_flags,mark_as_enabled_locally,2,
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                             [{file,"rabbit_feature_flags.erl"},{line,1202}]}]}
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:     in function  erpc:call/5 (erpc.erl, line 702)
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:     in call from rabbit_ff_controller:rpc_call/5 (rabbit_ff_controller.erl, line 1384)
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:     in call from rabbit_ff_controller:'-rpc_calls/5-fun-1-'/7 (rabbit_ff_controller.erl, line 1416)
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> 
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0> Feature flags: failed to enable `stream_update_config_command`: {error,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                  {exception,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                   {badmap,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                    rabbitmq_management},
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                   [{maps,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     filter,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                      rabbitmq_management],
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     [{file,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                       "maps.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                      {line,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                       611},
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                      {error_info,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                       #{module =>
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                          erl_stdlib_errors}}]},
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                    {rabbit_feature_flags,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     mark_as_enabled_locally,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     2,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     [{file,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                       "rabbit_feature_flags.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                      {line,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                       1202}]}]}}
2024-08-29 10:24:45 2024-08-29 14:24:45.576223+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0> 
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0> BOOT FAILED
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0> ===========
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0> Error during startup: {error,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                        {incompatible_feature_flags,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                         {exception,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                          {badmap,rabbitmq_management},
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                          [{maps,filter,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                            [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                             rabbitmq_management],
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                            [{file,"maps.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                             {line,611},
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                             {error_info,#{module => erl_stdlib_errors}}]},
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                           {rabbit_feature_flags,mark_as_enabled_locally,2,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                            [{file,"rabbit_feature_flags.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                             {line,1202}]}]}}}
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0> 
2024-08-29 10:24:45 
2024-08-29 10:24:45 BOOT FAILED
2024-08-29 10:24:45 ===========
2024-08-29 10:24:45 Error during startup: {error,
2024-08-29 10:24:45                        {incompatible_feature_flags,
2024-08-29 10:24:45                         {exception,
2024-08-29 10:24:45                          {badmap,rabbitmq_management},
2024-08-29 10:24:45                          [{maps,filter,
2024-08-29 10:24:45                            [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:45                             rabbitmq_management],
2024-08-29 10:24:45                            [{file,"maps.erl"},
2024-08-29 10:24:45                             {line,611},
2024-08-29 10:24:45                             {error_info,#{module => erl_stdlib_errors}}]},
2024-08-29 10:24:45                           {rabbit_feature_flags,mark_as_enabled_locally,2,
2024-08-29 10:24:45                            [{file,"rabbit_feature_flags.erl"},
2024-08-29 10:24:45                             {line,1202}]}]}}}
2024-08-29 10:24:45 
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>   crasher:
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     initial call: application_master:init/4
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     pid: <0.253.0>
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     registered_name: []
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     exception exit: {{incompatible_feature_flags,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                          {exception,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                              {badmap,rabbitmq_management},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                              [{maps,filter,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                   [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                    rabbitmq_management],
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                   [{file,"maps.erl"},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                    {line,611},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                    {error_info,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                        #{module => erl_stdlib_errors}}]},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                               {rabbit_feature_flags,mark_as_enabled_locally,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                   2,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                   [{file,"rabbit_feature_flags.erl"},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                    {line,1202}]}]}},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                      {rabbit,start,[normal,[]]}}
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>       in function  application_master:init/4 (application_master.erl, line 142)
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     ancestors: [<0.252.0>]
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     message_queue_len: 1
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     messages: [{'EXIT',<0.254.0>,normal}]
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     links: [<0.252.0>,<0.44.0>]
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     dictionary: []
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     trap_exit: true
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     status: running
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     heap_size: 2586
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     stack_size: 28
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     reductions: 212
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>   neighbours:
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0> 
2024-08-29 10:24:46 2024-08-29 14:24:46.615220+00:00 [notice] <0.44.0> Application rabbit exited with reason: {{incompatible_feature_flags,{exception,{badmap,rabbitmq_management},[{maps,filter,[#Fun<rabbit_feature_flags.0.3681879>,rabbitmq_management],[{file,"maps.erl"},{line,611},{error_info,#{module => erl_stdlib_errors}}]},{rabbit_feature_flags,mark_as_enabled_locally,2,[{file,"rabbit_feature_flags.erl"},{line,1202}]}]}},{rabbit,start,[normal,[]]}}
2024-08-29 10:24:46 Stack trace: 
2024-08-29 10:24:46 
2024-08-29 10:24:46 ** (CaseClauseError) no case clause matching: {:badrpc, :nodedown}
2024-08-29 10:24:46     (rabbitmqctl 3.13.0-dev) lib/rabbitmq/cli/core/helpers.ex:105: anonymous fn/2 in RabbitMQ.CLI.Core.Helpers.stream_until_error_parameterised/2
2024-08-29 10:24:46     (elixir 1.17.2) lib/stream.ex:990: Stream.do_transform_user/6
2024-08-29 10:24:46     (elixir 1.17.2) lib/stream.ex:1891: Enumerable.Stream.do_each/4
2024-08-29 10:24:46     (elixir 1.17.2) lib/enum.ex:2585: Enum.reduce_while/3
2024-08-29 10:24:46     (rabbitmqctl 3.13.0-dev) lib/rabbitmq/cli/core/output.ex:56: RabbitMQ.CLI.Core.Output.print_output_0/3
2024-08-29 10:24:46     (rabbitmqctl 3.13.0-dev) lib/rabbitmq/cli/core/output.ex:31: RabbitMQ.CLI.Core.Output.print_output/3
2024-08-29 10:24:46     (rabbitmqctl 3.13.0-dev) lib/rabbitmqctl.ex:234: RabbitMQCtl.process_output/3
2024-08-29 10:24:46     (rabbitmqctl 3.13.0-dev) lib/rabbitmqctl.ex:642: RabbitMQCtl.maybe_with_distribution/3
2024-08-29 10:24:46 
2024-08-29 10:24:59 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:24:46 Runtime terminating during boot (terminating)
2024-08-29 10:24:46 
2024-08-29 10:24:46 Crash dump is being written to: /opt/bitnami/rabbitmq/var/log/rabbitmq/erl_crash.dump...{:case_clause, {:badrpc, :nodedown}}
2024-08-29 10:24:46 
2024-08-29 10:24:47 done
2024-08-29 10:24:47 [os_mon] cpu supervisor port (cpu_sup): Erlang has closed
2024-08-29 10:24:47 [os_mon] memory supervisor port (memsup): Erlang has closed
2024-08-29 10:25:00 Error:
2024-08-29 10:25:00 process_not_running
2024-08-29 10:25:13 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:25:13 Error:
2024-08-29 10:25:13 process_not_running
2024-08-29 10:25:26 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:25:26 Error:
2024-08-29 10:25:26 process_not_running
2024-08-29 10:25:39 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:25:39 Error:
2024-08-29 10:25:39 process_not_running
2024-08-29 10:25:53 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:25:53 Error:
2024-08-29 10:25:53 process_not_running
2024-08-29 10:26:06 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:26:06 Error:
2024-08-29 10:26:06 process_not_running
2024-08-29 10:26:19 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:26:19 Error:
2024-08-29 10:26:19 process_not_running
2024-08-29 10:26:32 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:26:33 Error:
2024-08-29 10:26:33 process_not_running
2024-08-29 10:26:46 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:26:46 Error:
2024-08-29 10:26:46 process_not_running
2024-08-29 10:26:56 rabbitmq 14:26:56.45 ERROR ==> Couldn't start RabbitMQ in background.

@github-actions github-actions bot removed the triage Triage is needed label Aug 30, 2024
@github-actions github-actions bot assigned jotamartos and unassigned javsalgar Aug 30, 2024
@jotamartos
Copy link
Contributor

jotamartos commented Sep 2, 2024 •
edited
Loading

Tried to reproduce the issue in a M1-based laptop and didn't run into that error. The issue is probably related to your environment.

➜  rabbitmq git:(main) docker run --rm -d --name rabbitmq-server-2 -p 15672:15672 -p 5672:5672 -e RABBITMQ_LOGS=- -e RABBITMQ_LOG_LEVEL=debug bitnami/rabbitmq:3.13
Unable to find image 'bitnami/rabbitmq:3.13' locally
3.13: Pulling from bitnami/rabbitmq
f23a9536491c: Pull complete 
Digest: sha256:de47a2cd1082534cbb2cac399f49f583844b72f94f5a498f3c3bd4383dd013af
Status: Downloaded newer image for bitnami/rabbitmq:3.13
76d6e501f2f016401ea7c5eadf8a1fd3193b243082561d91e87292e91e764c62
➜  rabbitmq git:(main) docker ps -a 
CONTAINER ID   IMAGE                                                                             COMMAND                  CREATED         STATUS         PORTS                                                                                                       NAMES
76d6e501f2f0   bitnami/rabbitmq:3.13                                                             "/opt/bitnami/script…"   3 seconds ago   Up 2 seconds   4369/tcp, 5551-5552/tcp, 5671/tcp, 0.0.0.0:5672->5672/tcp, 15671/tcp, 25672/tcp, 0.0.0.0:15672->15672/tcp   rabbitmq-server-2
➜  rabbitmq git:(main) docker logs -f rabbitmq-server-2
rabbitmq 11:40:01.04 INFO  ==> 
rabbitmq 11:40:01.04 INFO  ==> Welcome to the Bitnami rabbitmq container
rabbitmq 11:40:01.04 INFO  ==> Subscribe to project updates by watching https://github.com/bitnami/containers
rabbitmq 11:40:01.04 INFO  ==> Submit issues and feature requests at https://github.com/bitnami/containers/issues
rabbitmq 11:40:01.04 INFO  ==> Upgrade to Tanzu Application Catalog for production environments to access custom-configured and pre-packaged software components. Gain enhanced features, including Software Bill of Materials (SBOM), CVE scan result reports, and VEX documents. To learn more, visit https://bitnami.com/enterprise
rabbitmq 11:40:01.04 INFO  ==> 
rabbitmq 11:40:01.04 INFO  ==> ** Starting RabbitMQ setup **
rabbitmq 11:40:01.05 INFO  ==> Validating settings in RABBITMQ_* env vars..
rabbitmq 11:40:01.06 INFO  ==> Initializing RabbitMQ...
rabbitmq 11:40:01.07 INFO  ==> Generating random cookie
rabbitmq 11:40:01.08 INFO  ==> Starting RabbitMQ in background...
rabbitmq 11:40:06.62 INFO  ==> No custom scripts in /docker-entrypoint-initdb.d
rabbitmq 11:40:06.63 INFO  ==> Stopping RabbitMQ...

rabbitmq 11:40:09.04 INFO  ==> ** RabbitMQ setup finished! **
rabbitmq 11:40:09.05 INFO  ==> ** Starting RabbitMQ **
2024-09-02 11:40:11.950177+00:00 [notice] <0.44.0> Application syslog exited with reason: stopped
2024-09-02 11:40:11.954924+00:00 [notice] <0.254.0> Logging: switching to configured handler(s); following messages may not be visible in this log output
2024-09-02 11:40:11.955339+00:00 [notice] <0.254.0> Logging: configured log handlers are now ACTIVE
2024-09-02 11:40:11.961664+00:00 [info] <0.254.0> ra: starting system quorum_queues
...
2024-09-02 11:40:14.886750+00:00 [info] <0.541.0> Server startup complete; 3 plugins started.
2024-09-02 11:40:14.886750+00:00 [info] <0.541.0>  * rabbitmq_management
2024-09-02 11:40:14.886750+00:00 [info] <0.541.0>  * rabbitmq_management_agent
2024-09-02 11:40:14.886750+00:00 [info] <0.541.0>  * rabbitmq_web_dispatch
2024-09-02 11:40:15.031214+00:00 [info] <0.9.0> Time to start RabbitMQ: 5817 ms

@lyriccoder
Copy link

lyriccoder commented Sep 5, 2024 •
edited
Loading

I have the same issue, with 3.13 and 3.12. Any solution?
It stucks at Couldn't start RabbitMQ in background.
If I add your variable with DEBUG, i See the following:

rabbitmq-1  | rabbitmq 10:41:58.38 INFO  ==>
rabbitmq-1  | rabbitmq 10:41:58.38 INFO  ==> Welcome to the Bitnami rabbitmq container
rabbitmq-1  | rabbitmq 10:41:58.39 INFO  ==> Subscribe to project updates by watching https://github.com/bitnami/containers
rabbitmq-1  | rabbitmq 10:41:58.39 INFO  ==> Submit issues and feature requests at https://github.com/bitnami/containers/issues
rabbitmq-1  | rabbitmq 10:41:58.39 INFO  ==> Upgrade to Tanzu Application Catalog for production environments to access custom-configured and pre-packaged software components. Gain enhanced features, including Software Bill of Materials (SBOM), CVE scan result reports, and VEX documents. To learn more, visit https://bitnami.com/enterprise
rabbitmq-1  | rabbitmq 10:41:58.39 INFO  ==>
rabbitmq-1  | rabbitmq 10:41:58.39 INFO  ==> ** Starting RabbitMQ setup **
rabbitmq-1  | rabbitmq 10:41:58.41 INFO  ==> Validating settings in RABBITMQ_* env vars..
rabbitmq-1  | rabbitmq 10:41:58.42 INFO  ==> Initializing RabbitMQ...
rabbitmq-1  | rabbitmq 10:41:58.43 DEBUG ==> Creating configuration file...
rabbitmq-1  | rabbitmq 10:41:58.43 DEBUG ==> Creating environment file...
rabbitmq-1  | rabbitmq 10:41:58.43 DEBUG ==> Creating enabled_plugins file...
rabbitmq-1  | rabbitmq 10:41:58.44 DEBUG ==> Creating Erlang cookie...
rabbitmq-1  | rabbitmq 10:41:58.44 INFO  ==> Generating random cookie
rabbitmq-1  | rabbitmq 10:41:58.45 DEBUG ==> Ensuring expected directories/files exist...
rabbitmq-1  | rabbitmq 10:41:58.46 INFO  ==> Starting RabbitMQ in background...
rabbitmq-1  | Waiting for erlang distribution on node 'rabbit@localhost' while OS process '60' is running
rabbitmq-1  | Error: operation wait on node rabbit@localhost timed out. Timeout value used: 5000
rabbitmq-1  | Waiting for erlang distribution on node 'rabbit@localhost' while OS process '60' is running
rabbitmq-1  | Error: operation wait on node rabbit@localhost timed out. Timeout value used: 5000

@jotamartos
Copy link
Contributor

Hi!

Could you launch the container with BITNAMI_DEBUG=true?

Did you try enabling the debug mode? As I mentioned above, I couldn't reproduce the issue locally and our pipelines do not report this issue either.

@lyriccoder
Copy link

lyriccoder commented Sep 13, 2024 •
edited
Loading

Hi!
Could you launch the container with BITNAMI_DEBUG=true?

Did you try enabling the debug mode? As I mentioned above, I couldn't reproduce the issue locally and our pipelines do not report this issue either.

I added BITNAMI_DEBUG=true, so the log is above the current post. I can reproduce it on different machines with Ubuntu. I mean can't even find version of Ubuntu where it works. Strange, that issue is not reproducible. Seems it's related to nodename. Seems it uses different nodename inside

@jotamartos
Copy link
Contributor

I mean can't even find version of Ubuntu where it works. Strange, that issue is not reproducible.

Just launched a fresh Ubuntu 24.04 machine

ubuntu@ip-172-31-15-51:~$ cat /etc/os-release
PRETTY_NAME="Ubuntu 24.04 LTS"
NAME="Ubuntu"
VERSION_ID="24.04"
VERSION="24.04 LTS (Noble Numbat)"
VERSION_CODENAME=noble
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=noble
LOGO=ubuntu-logo

and launched the docker run command again

$ docker run --rm --name rabbitmq-server-2 -p 15672:15672 -p 5672:5672 -e RABBITMQ_LOGS=- -e RABBITMQ_LOG_LEVEL=debug bitnami/rabbitmq:3.13
...
rabbitmq 10:56:20.73 INFO  ==> ** RabbitMQ setup finished! **

rabbitmq 10:56:20.75 INFO  ==> ** Starting RabbitMQ **
2024-09-16 10:56:25.455169+00:00 [notice] <0.44.0> Application syslog exited with reason: stopped
2024-09-16 10:56:25.461545+00:00 [notice] <0.254.0> Logging: switching to configured handler(s); following messages may not be visible in this log output
2024-09-16 10:56:25.464097+00:00 [notice] <0.254.0> Logging: configured log handlers are now ACTIVE
2024-09-16 10:56:25.491091+00:00 [info] <0.254.0> ra: starting system quorum_queues
...
  ##  ##      RabbitMQ 3.13.7
  ##  ##
  ##########  Copyright (c) 2007-2024 Broadcom Inc and/or its subsidiaries
  ######  ##
  ##########  Licensed under the MPL 2.0. Website: https://rabbitmq.com

  Erlang:      26.2.5 [jit]
  TLS Library: OpenSSL - OpenSSL 3.0.14 4 Jun 2024
...
2024-09-16 10:56:33.487698+00:00 [info] <0.533.0> Ready to start client connection listeners
2024-09-16 10:56:33.491210+00:00 [info] <0.653.0> started TCP listener on [::]:5672
 completed with 3 plugins.
2024-09-16 10:56:33.858551+00:00 [info] <0.533.0> Server startup complete; 3 plugins started.
2024-09-16 10:56:33.858551+00:00 [info] <0.533.0>  * rabbitmq_management
2024-09-16 10:56:33.858551+00:00 [info] <0.533.0>  * rabbitmq_management_agent
2024-09-16 10:56:33.858551+00:00 [info] <0.533.0>  * rabbitmq_web_dispatch
2024-09-16 10:56:34.054130+00:00 [info] <0.9.0> Time to start RabbitMQ: 12885 ms
...

As you can see, the deployment succeeded. I'm using the latest docker version obtained from https://get.docker.com/

ubuntu@ip-172-31-15-51:~$ docker --version
Docker version 27.2.1, build 9e34c9b

@lyriccoder
Copy link

@chengjie8 It seems the issue was caused by the long machine name. I accidentally used a different machine with a shorter name and found that it worked.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jotamartos jotamartos

Labels
rabbitmq solved tech-issues The user has a technical issue about an application
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@javsalgar @jotamartos @lyriccoder @chengjie8 and others