eturnal #2855

Zoey2936 · 2023-06-24T15:54:20Z

Address #2836

Containers/talk/Dockerfile

Containers/talk/start.sh

Zoey2936 · 2023-06-24T17:06:28Z

@sando38 can you please check if the "" are correctly set in the config, please?
and do you know if there is a better way then first setting ipv6 addresses to "" and the removing lines containing "" with sed? since eturnal crashes if there are empty ipv6 addresses

sando38 · 2023-06-24T17:32:58Z

@sando38 can you please check if the "" are correctly set in the config, please? and do you know if there is a better way then first setting ipv6 addresses to "" and the removing lines containing "" with sed? since eturnal crashes if there are empty ipv6 addresses

An alternative is to export ETURNAL_RELAY_IPV6_ADDR=${IPv6_ADDRESS_NC-}. So you could leave away the configuration item in the file. Same applies to the IPv4 address.

As for the question regarding the "", eturnal expects a string, so you cannot leave it away or keep it empty.

Zoey2936 · 2023-06-24T17:33:59Z

An alternative is to export ETURNAL_RELAY_IPV6_ADDR=${IPv6_ADDRESS_NC-}. So you could leave away the configuration item in the file. Same applies to the IPv4 address.

and for the whitelist?

Zoey2936 · 2023-06-24T17:34:21Z

do you think working with the downloaded tars works?

Containers/talk/Dockerfile

sando38 · 2023-06-24T17:39:34Z

do you think working with the downloaded tars works?

no, that does not work, as they are compiled for glibc. We have not yet decided to publish the musl libc binaries. That is part of the review work.

szaimen

some comments/questions

Containers/talk/Dockerfile

Containers/talk/start.sh

sando38

You probably want to change sed -i '/""/d' /opt/eturnal/etc/eturnal.yml to sed -i '/""/d' /conf/eturnal.yml as well.. or maybe even more smart, just use

$ETURNAL_ETC_DIR/eturnal.yml everywhere. :)

Signed-off-by: Zoey <zoey@z0ey.de>

Zoey2936 · 2023-08-10T07:17:27Z

thanks, fixed now

Containers/talk/start.sh

szaimen

LGTM! 🎉

Thank you very much @Zoey2936 and @sando38 ! 💙

sando38 · 2023-08-17T09:31:38Z

LGTM! 🎉

Thank you very much @Zoey2936 and @sando38 ! 💙

Welcome, feel free to contact us in case of further questions.

szaimen · 2023-08-17T11:05:17Z

@Zoey2936 I just tested this and it seems like something does not work correclty when I try to join via the talk-android app. No video is shown and it just keeps spinning. I get these logs. Any idea?

[WARN] [6668120615291095] Not video and not audio? dropping (SSRC 1473840597)...
[WARN] [6668120615291095] Not video and not audio? dropping (SSRC 1473840597)...
[WARN] [6668120615291095] Not video and not audio? dropping (SSRC 1473840597)...
[WARN] [6668120615291095] Not video and not audio? dropping (SSRC 1473840597)...
[WARN] [6668120615291095] Not video and not audio? dropping (SSRC 1473840597)...
[WARN] [6668120615291095] Not video and not audio? dropping (SSRC 1473840597)...
[WARN] [6668120615291095] Not video and not audio? dropping (SSRC 1473840597)...
[WARN] [6668120615291095] Not video and not audio? dropping (SSRC 1473840597)...
[WARN] [6668120615291095] Not video and not audio? dropping (SSRC 1473840597)...
[WARN] [6668120615291095] Not video and not audio? dropping (SSRC 1473840597)...
mcu_janus.go:558: Started listener &{{janus.plugin.videoroom map[room:45053958292921 started:ok videoroom:event]} map[] 8740759460924869 6574333439420545}
[WARN] [6668120615291095] Not video and not audio? dropping (SSRC 1473840597)...
[WARN] [6574333439420545] Failed to add some remote candidates (added 0, expected 1)
[WARN] [8892466403530236] Failed to add some remote candidates (added 0, expected 1)
[WARN] [6574333439420545] Failed to add some remote candidates (added 0, expected 1)
mcu_janus.go:1107: Subscriber 8892466403530236 received connected
[WARN] [6668120615291095] Didn't receive video #2 for more than a second...

Zoey2936 · 2023-08-18T12:45:07Z

no Idea, maybe @sando38 has an idea

sando38 · 2023-08-18T16:22:59Z

What are eturnal's log?

szaimen · 2023-08-18T16:31:06Z

Possibly we forgot to add the secret back?
https://eturnal.net/documentation/#secret

szaimen · 2023-08-18T16:32:35Z

Ah no, it is there.

So I guess I will need to test again and get the logs again...

szaimen · 2023-08-21T12:24:31Z

I've tested again and the same issue comes up again. After reverting this PR things start to work again.
Here are the logs:

++ dig nextcloud-aio-talk IN A +short
++ head -n1
++ grep '^[0-9.]\+$'
++ sort
+ IPv4_ADDRESS_TALK=172.20.0.3
++ sort
++ grep '^[0-9a-f:]\+$'
++ head -n1
++ dig nextcloud-aio-talk AAAA +short
+ IPv6_ADDRESS_TALK=fd12:3456:789a:2::3
++ dig mydomain.com IN A +short +https +tls-ca=/etc/ssl/certs/ca-certificates.crt @1.1.1.1
++ head -n1
++ grep '^[0-9.]\+$'
++ sort
+ IPv4_ADDRESS_NC=65.108.215.1
++ dig mydomain.com IN AAAA +short +https +tls-ca=/etc/ssl/certs/ca-certificates.crt @1.1.1.1
++ sort
++ grep '^[0-9a-f:]\+$'
++ head -n1
+ IPv6_ADDRESS_NC=2a01:4f9:c010:6870::1
+ set +x
Janus commit: 22298e847202d7ae6e60a0592130b6f96752789e
Compiled on:  Thu Aug 17 10:40:31 UTC 2023

Logger plugins folder: /usr/local/lib/janus/loggers
---------------------------------------------------
  Starting Meetecho Janus (WebRTC Server) v0.14.0
---------------------------------------------------

Checking command line arguments...
Debug/log level is 3
Debug/log timestamps are disabled
Debug/log colors are disabled
[WARN] Janus is deployed on a private address (172.20.0.3) but you didn't specify any STUN server! Expect trouble if this is supposed to work over the internet and not just in a LAN...
main.go:133: Starting up version 12de5a9b71afef06eaf171099712ef0a5f6ca0c4/go1.20.5 as pid 39
main.go:142: Using a maximum of 2 CPUs
natsclient.go:93: Could not create connection (nats: no servers available for connection), will retry in 1s
[WARN] libcurl not available, Streaming plugin will not have RTSP support
[WARN] libogg not available, Streaming plugin will not have file-based Opus streaming
[WARN] No Unix Sockets server started, giving up...
[WARN] The 'janus.transport.pfunix' plugin could not be initialized
[38] 2023/08/21 14:19:27.327485 [INF] Starting nats-server
[38] 2023/08/21 14:19:27.328005 [INF]   Version:  2.9.21
[38] 2023/08/21 14:19:27.328273 [INF]   Git:      [b2e7725]
[38] 2023/08/21 14:19:27.328508 [INF]   Name:     NDIU4NIDWDIVKL5SIVXU7HS72WV2XXARWRGJZF7IBVBAAQPPRQYGMSTU
[38] 2023/08/21 14:19:27.328733 [INF]   ID:       NDIU4NIDWDIVKL5SIVXU7HS72WV2XXARWRGJZF7IBVBAAQPPRQYGMSTU
[38] 2023/08/21 14:19:27.328965 [INF] Using configuration file: /etc/nats.conf
[38] 2023/08/21 14:19:27.334969 [INF] Listening for client connections on 127.0.0.1:4222
[38] 2023/08/21 14:19:27.335004 [INF] Server is ready
Exec: /opt/eturnal/erts-14.0.2/bin/erlexec -noinput +Bd -boot /opt/eturnal/releases/1.11.1/start -mode embedded -boot_var SYSTEM_LIB_DIR /opt/eturnal/lib -config /opt/eturnal/releases/1.11.1/sys.config -args_file /opt/eturnal/releases/1.11.1/vm.args -erl_epmd_port 3470 -start_epmd false -- foreground
Root: /opt/eturnal

rnal
natsclient.go:108: Connection established to nats://127.0.0.1:4222 (NDIU4NIDWDIVKL5SIVXU7HS72WV2XXARWRGJZF7IBVBAAQPPRQYGMSTU)
grpc_common.go:167: WARNING: No GRPC server certificate and/or key configured, running unencrypted
grpc_common.go:169: WARNING: No GRPC CA configured, expecting unencrypted connections
backend_storage_static.go:72: Backend backend-1 added for https://mydomain.com/
hub.go:200: Using a maximum of 8 concurrent backend connections per host
hub.go:207: Using a timeout of 10s for backend connections
hub.go:303: Not using GeoIP database
mcu_janus.go:294: Connected to Janus WebRTC Server 0.14.0 by Meetecho s.r.l.
mcu_janus.go:300: Found JANUS VideoRoom plugin 0.0.9 by Meetecho s.r.l.
mcu_janus.go:305: Data channels are supported
mcu_janus.go:309: Full-Trickle is enabled
mcu_janus.go:311: Maximum bandwidth 1048576 bits/sec per publishing stream
mcu_janus.go:312: Maximum bandwidth 2097152 bits/sec per screensharing stream
mcu_janus.go:318: Created Janus session 2197245586827560
mcu_janus.go:325: Created Janus handle 6709315372081925
main.go:263: Using janus MCU
hub.go:385: Using a timeout of 10s for MCU requests
backend_server.go:111: No IPs configured for the stats endpoint, only allowing access from 127.0.0.1
main.go:339: Listening on 0.0.0.0:8081
client.go:284: Client from 89.245.211.82 has RTT of 82 ms (82.838596ms)
capabilities.go:151: Capabilities expired for https://mydomain.com/ocs/v2.php/cloud/capabilities, updating
client.go:284: Client from 89.245.211.82 has RTT of 129 ms (129.231755ms)
capabilities.go:214: Received capabilities map[config:map[attachments:map[allowed:false] call:map[breakout-rooms:true can-upload-background:false enabled:true predefined-backgrounds:[1_office.jpg 2_home.jpg 3_abstract.jpg 4_beach.jpg 5_park.jpg 6_theater.jpg 7_library.jpg 8_space_station.jpg] recording:false supported-reactions:[❤️ 🎉 👏 👍 👎 😂 🤩 🤔 😲 😥]] chat:map[max-length:32000 read-privacy:0 translations:[] typing-privacy:0] conversations:map[can-create:false] previews:map[max-gif-size:3.145728e+06] signaling:map[hello-v2-token-key:-----BEGIN PUBLIC KEY-----
MFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAE2yTl7rTEWW3stDUCnDUinxjMKWBU
SJrC7bLOodDhR16yvXtz+VCbYnu7+7AOz7Bnx27Fp0M3eoLyjiEM03r3KA==
-----END PUBLIC KEY-----
 session-ping-limit:200]] features:[audio video chat-v2 conversation-v4 guest-signaling empty-group-room guest-display-names multi-room-users favorites last-room-activity no-ping system-messages delete-messages mention-flag in-call-flags conversation-call-flags notification-levels invite-groups-and-mails locked-one-to-one-rooms read-only-rooms listable-rooms chat-read-marker chat-unread webinary-lobby start-call-flag chat-replies circles-support force-mute sip-support sip-support-nopin chat-read-status phonebook-search raise-hand room-description rich-object-sharing temp-user-avatar-api geo-location-sharing voice-message-sharing signaling-v3 publishing-permissions clear-history direct-mention-flag notification-calls conversation-permissions rich-object-list-media rich-object-delete unified-search chat-permission silent-send silent-call send-call-notification talk-polls breakout-rooms-v1 recording-v1 avatar chat-get-context single-conversation-status chat-keep-notifications typing-privacy message-expiration reactions chat-reference-id] version:17.0.3] from https://mydomain.com/ocs/v2.php/cloud/capabilities
hub.go:740: Register user admin@backend-1 from 89.245.211.82 in unknown-country (Mozilla/5.0 (Android) Nextcloud-Talk v17.10.0 Alpha 14) FoGvZzEkgA2XqdhBXvfHPQhWIV-U_yDh2kaV8iMgfHB8PT13dUJMek5mb0NMLVlVWGpsbzNTV3hDSUNHamk3NjI0Z3RuSkRLc2UxdzBfMTZjUElrT0h1SmNONFo4aFdia0RoNEszbHg2T0h2ZktVa0xXakl5Sy1veUFYRmMwMXlTOFUyV0dOcEdvdkVYZHpmZERGZUZ3THo2R2RIaUhWZG5mMTI0cWFSemJCa2hpdGs5eXpVN1REQlU2R21hWkYzRnA3Q1UwZUNmTTFNQWl6UDN8ODYzMDI2Mjk2MQ== (private=MTY5MjYyMDM2OHxQZGNNVlNvY0psZ0NoSU14b0lLWGlndnJkRXNCajQ1Y0h4OGM0LU14bnJ5dWQ3SW5IaEQ5VmVXeEcxa2dqb0p5Y19nbEN1cGhIMElmSWFaN2U1QlBNRkJ0R0R0WVNWUWI4STNNbG5IMHlIWTlpV1JnSU42VWd5MUlPa0huSVZYWlRLa2dscTdBUjJQUVlFNGxiNTZMN3dfS3JmRGtMc3ZGVDM1cERka2k3cmhDR0E9PXzANTzqqFe8mFlD1-hNL3atOP340aNYOlr42yWPLHL2uw==)
client.go:303: Error reading from 89.245.211.82: read tcp 172.20.0.3:8081->172.20.0.9:37278: use of closed network connection
client.go:284: Client from 89.245.211.82 has RTT of 43 ms (43.502641ms)
hub.go:740: Register user test@backend-1 from 89.245.211.82 in unknown-country (Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/116.0) uyzrHX8-F8359tb-mxq3ScOUVFRTRQQ3ecjrWTLlqR58PT13U3U3Y1ZnRXdUMzBaZjY0cWxrdVlSUl9sOUJGSEJUYy1QTDBiaGdFR0dQT2NpbkxzeEk5NlZOX0cydDFJWU1aeEd4dXZ0cVRKUWl1UXRZempHekdSMnVPMkJVdW1SblB6aHRxQVFDVlBvUUgzbEJqRjh6Vjd4cl80bDBTb3lFUndzd1lDOWdBS1ZsUDRGT3JIcG5uMzhPRnFscURfZnR6ODRxY0VkRWFRTldRWUd8ODczMDI2Mjk2MQ== (private=MTY5MjYyMDM3OHw1OExMR3JBUU9RbzNDcnY4Skk4MXkya2NtUnRib09GaW1TZTVlc0djUmJmN3NmMVZnM3ZZc2ZaQ2k2by0tbk9HT0xrX0RBR09wbHBpQWJUQkd1c3ljZE02TlFYUUliaDFXWi0wYk0xMlp2TDMyMS04VUl2N2hfUzUzQkxOSms5WEthRXlKek5pcXE5bHBNdHhob2RGQ0lHNUFsSk95MmJ6ZXVNU3FTTkY1TWd6T2c9PXylCKTQLUZClFLbB8TrYG83AJTgYMiJGREi9tiK8GKS4w==)
clientsession.go:434: Session uyzrHX8-F8359tb-mxq3ScOUVFRTRQQ3ecjrWTLlqR58PT13U3U3Y1ZnRXdUMzBaZjY0cWxrdVlSUl9sOUJGSEJUYy1QTDBiaGdFR0dQT2NpbkxzeEk5NlZOX0cydDFJWU1aeEd4dXZ0cVRKUWl1UXRZempHekdSMnVPMkJVdW1SblB6aHRxQVFDVlBvUUgzbEJqRjh6Vjd4cl80bDBTb3lFUndzd1lDOWdBS1ZsUDRGT3JIcG5uMzhPRnFscURfZnR6ODRxY0VkRWFRTldRWUd8ODczMDI2Mjk2MQ== joined room 7mwakygo with room session id Q3Uj7nnrdfu+6jW7W6PleWhQxXSbMn2FCBlquCVolf1mNBFdRFKDQcukErLcf9GnhSsjs6v1aTxxtO5BvNmuQqVcoA8IaD73ya6aCNauSMFs+KmKuaxSXg2PooSa7VVksDWNo66UAU402IvIdYBoEPLY6zu54Z+NYcgAkzsl7XByBkjgqgmhLN5wmXaopl3Z8GpTxI3g8BIsHXw6QvxK8BV9enVJAwzpy7g/S5UQdzwKa85MjTNHBbKJUbbUsLS
clientsession.go:286: Permissions of session uyzrHX8-F8359tb-mxq3ScOUVFRTRQQ3ecjrWTLlqR58PT13U3U3Y1ZnRXdUMzBaZjY0cWxrdVlSUl9sOUJGSEJUYy1QTDBiaGdFR0dQT2NpbkxzeEk5NlZOX0cydDFJWU1aeEd4dXZ0cVRKUWl1UXRZempHekdSMnVPMkJVdW1SblB6aHRxQVFDVlBvUUgzbEJqRjh6Vjd4cl80bDBTb3lFUndzd1lDOWdBS1ZsUDRGT3JIcG5uMzhPRnFscURfZnR6ODRxY0VkRWFRTldRWUd8ODczMDI2Mjk2MQ== changed: [publish-audio publish-video publish-screen control]
[38] 2023/08/21 14:20:09.867723 [INF] Initiating Shutdown...
[38] 2023/08/21 14:20:09.868634 [INF] Server Exiting..
Stopping server, please wait...
Bye!
++ dig nextcloud-aio-talk IN A +short
++ head -n1
++ sort
++ grep '^[0-9.]\+$'
+ IPv4_ADDRESS_TALK=172.20.0.3
++ dig nextcloud-aio-talk AAAA +short
++ sort
++ head ++ grep '^[0-9a-f:]\+$'
-n1
+ IPv6_ADDRESS_TALK=fd12:3456:789a:2::3
++ head -n1
++ sort
++ grep '^[0-9.]\+$'
++ dig mydomain.com IN A +short +https +tls-ca=/etc/ssl/certs/ca-certificates.crt @1.1.1.1
+ IPv4_ADDRESS_NC=65.108.215.1
++ dig mydomain.com IN AAAA +short +https +tls-ca=/etc/ssl/certs/ca-certificates.crt @1.1.1.1
++ sort
++ grep '^[0-9a-f:]\+$'
++ head -n1
+ IPv6_ADDRESS_NC=2a01:4f9:c010:6870::1
+ set +x
Janus commit: 22298e847202d7ae6e60a0592130b6f96752789e
Compiled on:  Thu Aug 17 10:40:31 UTC 2023

main.go:133: Starting up version 12de5a9b71afef06eaf171099712ef0a5f6ca0c4/go1.20.5 as pid 39
main.go:142: Using a maximum of 2 CPUs
natsclient.go:93: Could not create connection (nats: no servers available for connection), will retry in 1s
Logger plugins folder: /usr/local/lib/janus/loggers
---------------------------------------------------
  Starting Meetecho Janus (WebRTC Server) v0.14.0
---------------------------------------------------

Checking command line arguments...
Debug/log level is 3
Debug/log timestamps are disabled
Debug/log colors are disabled
[WARN] Janus is deployed on a private address (172.20.0.3) but you didn't specify any STUN server! Expect trouble if this is supposed to work over the internet and not just in a LAN...
[38] 2023/08/21 14:20:14.803486 [INF] Starting nats-server
[38] 2023/08/21 14:20:14.807497 [INF]   Version:  2.9.21
[38] 2023/08/21 14:20:14.807955 [INF]   Git:      [b2e7725]
[38] 2023/08/21 14:20:14.808246 [INF]   Name:     NAEWXFJKAM4R5OLHYSDOFSVPEQXEPVYSIK3LSAOBY7QQBGMZ4PRP2SVZ
[38] 2023/08/21 14:20:14.808495 [INF]   ID:       NAEWXFJKAM4R5OLHYSDOFSVPEQXEPVYSIK3LSAOBY7QQBGMZ4PRP2SVZ
[38] 2023/08/21 14:20:14.808747 [INF] Using configuration file: /etc/nats.conf
[38] 2023/08/21 14:20:14.815095 [INF] Listening for client connections on 127.0.0.1:4222
[38] 2023/08/21 14:20:14.815942 [INF] Server is ready
[WARN] libcurl not available, Streaming plugin will not have RTSP support
[WARN] libogg not available, Streaming plugin will not have file-based Opus streaming
[WARN] No Unix Sockets server started, giving up...
[WARN] The 'janus.transport.pfunix' plugin could not be initialized
Exec: /opt/eturnal/erts-14.0.2/bin/erlexec -noinput +Bd -boot /opt/eturnal/releases/1.11.1/start -mode embedded -boot_var SYSTEM_LIB_DIR /opt/eturnal/lib -config /opt/eturnal/releases/1.11.1/sys.config -args_file /opt/eturnal/releases/1.11.1/vm.args -erl_epmd_port 3470 -start_epmd false -- foreground
Root: /opt/eturnal

rnal
natsclient.go:108: Connection established to nats://127.0.0.1:4222 (NAEWXFJKAM4R5OLHYSDOFSVPEQXEPVYSIK3LSAOBY7QQBGMZ4PRP2SVZ)
grpc_common.go:167: WARNING: No GRPC server certificate and/or key configured, running unencrypted
grpc_common.go:169: WARNING: No GRPC CA configured, expecting unencrypted connections
backend_storage_static.go:72: Backend backend-1 added for https://mydomain.com/
hub.go:200: Using a maximum of 8 concurrent backend connections per host
hub.go:207: Using a timeout of 10s for backend connections
hub.go:303: Not using GeoIP database
mcu_janus.go:294: Connected to Janus WebRTC Server 0.14.0 by Meetecho s.r.l.
mcu_janus.go:300: Found JANUS VideoRoom plugin 0.0.9 by Meetecho s.r.l.
mcu_janus.go:305: Data channels are supported
mcu_janus.go:309: Full-Trickle is enabled
mcu_janus.go:311: Maximum bandwidth 1048576 bits/sec per publishing stream
mcu_janus.go:312: Maximum bandwidth 2097152 bits/sec per screensharing stream
mcu_janus.go:318: Created Janus session 4215117486414649
mcu_janus.go:325: Created Janus handle 5275573902364504
main.go:263: Using janus MCU
hub.go:385: Using a timeout of 10s for MCU requests
backend_server.go:111: No IPs configured for the stats endpoint, only allowing access from 127.0.0.1
main.go:339: Listening on 0.0.0.0:8081
client.go:284: Client from 89.245.211.82 has RTT of 90 ms (90.934021ms)
capabilities.go:151: Capabilities expired for https://mydomain.com/ocs/v2.php/cloud/capabilities, updating
client.go:284: Client from 89.245.211.82 has RTT of 121 ms (121.295091ms)
capabilities.go:214: Received capabilities map[config:map[attachments:map[allowed:false] call:map[breakout-rooms:true can-upload-background:false enabled:true predefined-backgrounds:[1_office.jpg 2_home.jpg 3_abstract.jpg 4_beach.jpg 5_park.jpg 6_theater.jpg 7_library.jpg 8_space_station.jpg] recording:false supported-reactions:[❤️ 🎉 👏 👍 👎 😂 🤩 🤔 😲 😥]] chat:map[max-length:32000 read-privacy:0 translations:[] typing-privacy:0] conversations:map[can-create:false] previews:map[max-gif-size:3.145728e+06] signaling:map[hello-v2-token-key:-----BEGIN PUBLIC KEY-----
MFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAE2yTl7rTEWW3stDUCnDUinxjMKWBU
SJrC7bLOodDhR16yvXtz+VCbYnu7+7AOz7Bnx27Fp0M3eoLyjiEM03r3KA==
-----END PUBLIC KEY-----
 session-ping-limit:200]] features:[audio video chat-v2 conversation-v4 guest-signaling empty-group-room guest-display-names multi-room-users favorites last-room-activity no-ping system-messages delete-messages mention-flag in-call-flags conversation-call-flags notification-levels invite-groups-and-mails locked-one-to-one-rooms read-only-rooms listable-rooms chat-read-marker chat-unread webinary-lobby start-call-flag chat-replies circles-support force-mute sip-support sip-support-nopin chat-read-status phonebook-search raise-hand room-description rich-object-sharing temp-user-avatar-api geo-location-sharing voice-message-sharing signaling-v3 publishing-permissions clear-history direct-mention-flag notification-calls conversation-permissions rich-object-list-media rich-object-delete unified-search chat-permission silent-send silent-call send-call-notification talk-polls breakout-rooms-v1 recording-v1 avatar chat-get-context single-conversation-status chat-keep-notifications typing-privacy message-expiration reactions chat-reference-id] version:17.0.3] from https://mydomain.com/ocs/v2.php/cloud/capabilities
hub.go:740: Register user admin@backend-1 from 89.245.211.82 in unknown-country (Mozilla/5.0 (Android) Nextcloud-Talk v17.10.0 Alpha 14) Hx_mCrrRex5shq9z3Nj7kI-NTATdYrhkJRSUHZQ-av58PT1nSDFJMExkbGFLMkFXOXB6VU1pcDV0SW45eVF2WEk1aV9MSHNEenlxLUZhUngyOW9zcFpqUGNrWWVfQjk0ZXloVW1lOW5aZFRXZjVNMmI4cS1fRVR2RUc3UWtrN3k1ZVdKd1dkdnA3MkJKTnROZW9QTFl2S29aZG1vNUFQbGRtRGZ6bE1WZjRkLTF4NDMtdGFWQjhxNUhfTmJUbEctVFMzM1U2OXNMNzJtOXJTX0F8NjE0MDI2Mjk2MQ== (private=MTY5MjYyMDQxNnx5T1IycVppRVZyZDFwRXhlbmlibU1DdWxHUG5ZaHVidjYyQTJOQ1A3NHI5SklsUzN4TVBzZnhvVEFEM2ExZXM1SXVXWGNDQm5rQ0ZjS3BmdW5IdjViOWdsQUhjSGtWZkE5WmRQUFl0UmozSnh2Y2JTVUFtNFotd1hKaUVtMGV1VFBrd2l4aXNxcjBsQkdpd2VkVmY1OVE0akVKRjdRbnFZd3M5OFJzeEQxQUp6TWc9PXxRYyAKbXji5Lwb4_fwv0gZftb8wKjG9ZcYmVzCWZjVXQ==)
2023-08-21 14:20:17.039096+02:00 [notice] Starting eturnal 1.11.1 on Erlang/OTP 26 (ERTS 14.0.2)
2023-08-21 14:20:17.039303+02:00 [info] Got no NOTIFY_SOCKET, notifications disabled
2023-08-21 14:20:17.039435+02:00 [info] Relay IPv4 address: 65.108.215.1 (port range: 49152-65535)
2023-08-21 14:20:17.039511+02:00 [info] Relay IPv6 address: 2a01:4f9:c010:6870::1 (port range: 49152-65535)
2023-08-21 14:20:17.039617+02:00 [info] Listening on 127.0.0.1:3470 (tcp) (Erlang protocol version 5)
2023-08-21 14:20:17.040257+02:00 [info] Listening on [::]:3478 (udp) (STUN/TURN)
2023-08-21 14:20:17.040677+02:00 [info] Listening on [::]:3478 (tcp) (STUN/TURN)
client.go:284: Client from 89.245.211.82 has RTT of 40 ms (40.399352ms)
hub.go:740: Register user test@backend-1 from 89.245.211.82 in unknown-country (Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/116.0) ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ== (private=MTY5MjYyMDQxOHx0ZFRQcG5rU1FQckFHSFZWOWZqbWFlcTFSZVcwa1BCTkc1eGFsekRyZXJMSktJSU10ZGtWVkdabkgtTkpVaGdWV0tuUzFOSzJGQXYtM2NfejJoMGFldFJVZUpLRFUtbnZkSy1NdzlYRVBZMG1kOFB5MW9vWnk1TnpOUF9ZTjR6cVJ3VjU0ekhoU0FxODdvcGJmbXRWUzFDYkt3T2FKalpNQzBQblI1MGhZY2h2ZGc9PXyJELNqy0kKYGhftHJ9ewEvFQW3hvTKU4P3y4ulm_Zn3A==)
clientsession.go:434: Session ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ== joined room 7mwakygo with room session id f1PEY82q4trzCfaGKR+13ePQunxCKfH826zqRBw9nRmwwyVErdtIMgbiI5lZlMzgObr96m8DYrIw4jAAw4dw9+8PJ4Dt2BqvNczRYaDB2Iwln7Bo7PeqaqGcEBxCbQT9Pn569yZnYpHrdnlbE7BLGaYgde3ZvurxvqRG0+zHQnvcl4FY37rFEMXsBTvFNPKHkmwCEd+aWTpgk4VTYMGjf/2p9xp6mhW7pxX8gWi84hjy6TpyWKj3MPcuMxzJ94/
clientsession.go:286: Permissions of session ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ== changed: [publish-audio publish-video publish-screen control]
client.go:303: Error reading from 89.245.211.82: read tcp 172.20.0.3:8081->172.20.0.9:48468: use of closed network connection
mcu_janus.go:729: Attached video as publisher 6615153529480378 to plugin janus.plugin.videoroom in session 4215117486414649
mcu_janus.go:767: Created room 457032769467417 {janus.plugin.videoroom map[permanent:false room:457032769467417 videoroom:created]}
mcu_janus.go:825: Publisher ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ== is using handle 6615153529480378
clientsession.go:890: Publishing video as 1 for session ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ==
janus_client.go:490: Received event for unknown transaction, ignoring: {
   "janus": "ack",
   "session_id": 4215117486414649,
   "transaction": "6"
}
[WARN] [6615153529480378] Peer video fallback SSRC: 4181544561
2023-08-21 14:20:21.620117+02:00 [info] Accepting connection: 89.245.211.82:64163 -> 172.20.0.3:3478 [TCP, session w9m65sygz43v]
2023-08-21 14:20:21.628585+02:00 [info] Accepting connection: 89.245.211.82:64167 -> 172.20.0.3:3478 [TCP, session f0zhb8rr4fgx]
2023-08-21 14:20:21.662015+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session w9m65sygz43v, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64163]
2023-08-21 14:20:21.663669+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [TCP, session w9m65sygz43v, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64163, relay 65.108.215.1:57188]
2023-08-21 14:20:21.728808+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session f0zhb8rr4fgx, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64167]
2023-08-21 14:20:21.730421+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [TCP, session f0zhb8rr4fgx, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64167, relay 65.108.215.1:54496]
[WARN] [6615153529480378] Failed to add some remote candidates (added 0, expected 1)
2023-08-21 14:20:21.754141+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session w9m65sygz43v, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64163]
2023-08-21 14:20:21.754361+02:00 [info] Creating TURN permission for 172.20.0.3 [TCP, session w9m65sygz43v, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64163, relay 65.108.215.1:57188]
room.go:656: Session ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ== joined call 7mwakygo
mcu_janus.go:864: Publisher 6615153529480378 received connected
[WARN] [6615153529480378] Not video and not audio? dropping (SSRC 1802338683)...
[WARN] [6615153529480378] Not video and not audio? dropping (SSRC 2802411147)...
2023-08-21 14:20:22.177248+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session 3nci8r962ljm, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64412]
2023-08-21 14:20:22.178681+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [UDP, session 3nci8r962ljm, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64412, relay 65.108.215.1:49799]
2023-08-21 14:20:22.319290+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session rkwnwweupiml, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64416]
2023-08-21 14:20:22.321410+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [UDP, session rkwnwweupiml, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64416, relay 65.108.215.1:59864]
clientsession.go:434: Session Hx_mCrrRex5shq9z3Nj7kI-NTATdYrhkJRSUHZQ-av58PT1nSDFJMExkbGFLMkFXOXB6VU1pcDV0SW45eVF2WEk1aV9MSHNEenlxLUZhUngyOW9zcFpqUGNrWWVfQjk0ZXloVW1lOW5aZFRXZjVNMmI4cS1fRVR2RUc3UWtrN3k1ZVdKd1dkdnA3MkJKTnROZW9QTFl2S29aZG1vNUFQbGRtRGZ6bE1WZjRkLTF4NDMtdGFWQjhxNUhfTmJUbEctVFMzM1U2OXNMNzJtOXJTX0F8NjE0MDI2Mjk2MQ== joined room 7mwakygo with room session id TYKLFU8F+rHpITnGCLw2O4sdGxtpVsWT25dtchKH91YKuqaGJwfVIlqGgQBlaS1jT+FGpGyBqh8YCiQZKwMaY18zK7edZECDCacreGrHBF9sZwi1ceJ1lYPKjgxNcCapjoE9c9zccaR6XFt6pUdqkYENB33vnJTXVnq7rFeB8uUImbb0O+zpum3AghE7kNRJxYv9wyLWzan2/ta3TFmzgbNoN69NV/DviTkMGnkq6fENktongnSReMmjpqGSa6A
clientsession.go:286: Permissions of session Hx_mCrrRex5shq9z3Nj7kI-NTATdYrhkJRSUHZQ-av58PT1nSDFJMExkbGFLMkFXOXB6VU1pcDV0SW45eVF2WEk1aV9MSHNEenlxLUZhUngyOW9zcFpqUGNrWWVfQjk0ZXloVW1lOW5aZFRXZjVNMmI4cS1fRVR2RUc3UWtrN3k1ZVdKd1dkdnA3MkJKTnROZW9QTFl2S29aZG1vNUFQbGRtRGZ6bE1WZjRkLTF4NDMtdGFWQjhxNUhfTmJUbEctVFMzM1U2OXNMNzJtOXJTX0F8NjE0MDI2Mjk2MQ== changed: [publish-audio publish-video publish-screen]
room.go:656: Session Hx_mCrrRex5shq9z3Nj7kI-NTATdYrhkJRSUHZQ-av58PT1nSDFJMExkbGFLMkFXOXB6VU1pcDV0SW45eVF2WEk1aV9MSHNEenlxLUZhUngyOW9zcFpqUGNrWWVfQjk0ZXloVW1lOW5aZFRXZjVNMmI4cS1fRVR2RUc3UWtrN3k1ZVdKd1dkdnA3MkJKTnROZW9QTFl2S29aZG1vNUFQbGRtRGZ6bE1WZjRkLTF4NDMtdGFWQjhxNUhfTmJUbEctVFMzM1U2OXNMNzJtOXJTX0F8NjE0MDI2Mjk2MQ== joined call 7mwakygo
mcu_janus.go:729: Attached video as publisher 149239495294434 to plugin janus.plugin.videoroom in session 4215117486414649
mcu_janus.go:767: Created room 3949966769301461 {janus.plugin.videoroom map[permanent:false room:3949966769301461 videoroom:created]}
mcu_janus.go:825: Publisher Hx_mCrrRex5shq9z3Nj7kI-NTATdYrhkJRSUHZQ-av58PT1nSDFJMExkbGFLMkFXOXB6VU1pcDV0SW45eVF2WEk1aV9MSHNEenlxLUZhUngyOW9zcFpqUGNrWWVfQjk0ZXloVW1lOW5aZFRXZjVNMmI4cS1fRVR2RUc3UWtrN3k1ZVdKd1dkdnA3MkJKTnROZW9QTFl2S29aZG1vNUFQbGRtRGZ6bE1WZjRkLTF4NDMtdGFWQjhxNUhfTmJUbEctVFMzM1U2OXNMNzJtOXJTX0F8NjE0MDI2Mjk2MQ== is using handle 149239495294434
clientsession.go:890: Publishing video as 2 for session Hx_mCrrRex5shq9z3Nj7kI-NTATdYrhkJRSUHZQ-av58PT1nSDFJMExkbGFLMkFXOXB6VU1pcDV0SW45eVF2WEk1aV9MSHNEenlxLUZhUngyOW9zcFpqUGNrWWVfQjk0ZXloVW1lOW5aZFRXZjVNMmI4cS1fRVR2RUc3UWtrN3k1ZVdKd1dkdnA3MkJKTnROZW9QTFl2S29aZG1vNUFQbGRtRGZ6bE1WZjRkLTF4NDMtdGFWQjhxNUhfTmJUbEctVFMzM1U2OXNMNzJtOXJTX0F8NjE0MDI2Mjk2MQ==
mcu_janus.go:1024: Attached subscriber to room 457032769467417 of publisher ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ== in plugin janus.plugin.videoroom in session 4215117486414649 as 86600116291243
clientsession.go:967: Subscribing video from ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ== as 3 in session Hx_mCrrRex5shq9z3Nj7kI-NTATdYrhkJRSUHZQ-av58PT1nSDFJMExkbGFLMkFXOXB6VU1pcDV0SW45eVF2WEk1aV9MSHNEenlxLUZhUngyOW9zcFpqUGNrWWVfQjk0ZXloVW1lOW5aZFRXZjVNMmI4cS1fRVR2RUc3UWtrN3k1ZVdKd1dkdnA3MkJKTnROZW9QTFl2S29aZG1vNUFQbGRtRGZ6bE1WZjRkLTF4NDMtdGFWQjhxNUhfTmJUbEctVFMzM1U2OXNMNzJtOXJTX0F8NjE0MDI2Mjk2MQ==
mcu_janus.go:1024: Attached subscriber to room 3949966769301461 of publisher Hx_mCrrRex5shq9z3Nj7kI-NTATdYrhkJRSUHZQ-av58PT1nSDFJMExkbGFLMkFXOXB6VU1pcDV0SW45eVF2WEk1aV9MSHNEenlxLUZhUngyOW9zcFpqUGNrWWVfQjk0ZXloVW1lOW5aZFRXZjVNMmI4cS1fRVR2RUc3UWtrN3k1ZVdKd1dkdnA3MkJKTnROZW9QTFl2S29aZG1vNUFQbGRtRGZ6bE1WZjRkLTF4NDMtdGFWQjhxNUhfTmJUbEctVFMzM1U2OXNMNzJtOXJTX0F8NjE0MDI2Mjk2MQ== in plugin janus.plugin.videoroom in session 4215117486414649 as 5427407491212957
clientsession.go:967: Subscribing video from Hx_mCrrRex5shq9z3Nj7kI-NTATdYrhkJRSUHZQ-av58PT1nSDFJMExkbGFLMkFXOXB6VU1pcDV0SW45eVF2WEk1aV9MSHNEenlxLUZhUngyOW9zcFpqUGNrWWVfQjk0ZXloVW1lOW5aZFRXZjVNMmI4cS1fRVR2RUc3UWtrN3k1ZVdKd1dkdnA3MkJKTnROZW9QTFl2S29aZG1vNUFQbGRtRGZ6bE1WZjRkLTF4NDMtdGFWQjhxNUhfTmJUbEctVFMzM1U2OXNMNzJtOXJTX0F8NjE0MDI2Mjk2MQ== as 4 in session ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ==
mcu_janus.go:558: Started listener &{{janus.plugin.videoroom map[room:457032769467417 started:ok videoroom:event]} map[] 4215117486414649 86600116291243}
2023-08-21 14:20:24.007446+02:00 [info] Accepting connection: 89.245.211.82:49797 -> 172.20.0.3:3478 [TCP, session itp2btgkqfol]
mcu_janus.go:558: Started listener &{{janus.plugin.videoroom map[room:3949966769301461 started:ok videoroom:event]} map[] 4215117486414649 5427407491212957}
2023-08-21 14:20:24.012764+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session jjs57s8ti9cj, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:53753]
2023-08-21 14:20:24.014194+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [UDP, session jjs57s8ti9cj, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:53753, relay 65.108.215.1:56452]
2023-08-21 14:20:24.057993+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session x4soitlqol7n, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:53753]
2023-08-21 14:20:24.058210+02:00 [info] Creating TURN permission for 172.20.0.3 [UDP, session jjs57s8ti9cj, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:53753, relay 65.108.215.1:56452]
2023-08-21 14:20:24.058576+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session itp2btgkqfol, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:49797]
2023-08-21 14:20:24.058864+02:00 [info] Accepting connection: 89.245.211.82:64184 -> 172.20.0.3:3478 [TCP, session a4mtizce5bmd]
2023-08-21 14:20:24.060312+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [TCP, session itp2btgkqfol, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:49797, relay 65.108.215.1:49462]
[WARN] [149239495294434] Failed to add some remote candidates (added 0, expected 1)
2023-08-21 14:20:24.101255+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session a4mtizce5bmd, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64184]
2023-08-21 14:20:24.102164+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [TCP, session a4mtizce5bmd, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64184, relay 65.108.215.1:57961]
2023-08-21 14:20:24.102803+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session itp2btgkqfol, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:49797]
2023-08-21 14:20:24.102990+02:00 [info] Creating TURN permission for 172.20.0.3 [TCP, session itp2btgkqfol, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:49797, relay 65.108.215.1:49462]
2023-08-21 14:20:24.130963+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session a294u8v2dgxk, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:40463]
2023-08-21 14:20:24.132532+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [UDP, session a294u8v2dgxk, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:40463, relay 65.108.215.1:50973]
2023-08-21 14:20:24.146334+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session a4mtizce5bmd, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64184]
2023-08-21 14:20:24.146642+02:00 [info] Creating TURN permission for 172.20.0.3 [TCP, session a4mtizce5bmd, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64184, relay 65.108.215.1:57961]
2023-08-21 14:20:24.149972+02:00 [info] Accepting connection: 89.245.211.82:37157 -> 172.20.0.3:3478 [TCP, session uff3h9wna8xk]
[WARN] [5427407491212957] Failed to add some remote candidates (added 0, expected 1)
2023-08-21 14:20:24.200013+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session uff3h9wna8xk, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:37157]
2023-08-21 14:20:24.200861+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [TCP, session uff3h9wna8xk, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:37157, relay 65.108.215.1:50161]
2023-08-21 14:20:24.201611+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session edaq5tnza5cr, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:40463]
2023-08-21 14:20:24.202318+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session 60mje6eq6mci, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:53753]
2023-08-21 14:20:24.202706+02:00 [info] Creating TURN permission for 172.20.0.3 [UDP, session a294u8v2dgxk, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:40463, relay 65.108.215.1:50973]
2023-08-21 14:20:24.203013+02:00 [info] Refreshing TURN permission for 172.20.0.3 [UDP, session jjs57s8ti9cj, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:53753, relay 65.108.215.1:56452]
2023-08-21 14:20:24.218730+02:00 [info] Binding TURN channel 4000 for peer 172.20.0.3:48995 [UDP, session jjs57s8ti9cj, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:53753, relay 65.108.215.1:56452]
[WARN] [86600116291243] Failed to add some remote candidates (added 0, expected 1)
2023-08-21 14:20:24.242789+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session uff3h9wna8xk, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:37157]
2023-08-21 14:20:24.243025+02:00 [info] Creating TURN permission for 172.20.0.3 [TCP, session uff3h9wna8xk, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:37157, relay 65.108.215.1:50161]
2023-08-21 14:20:24.267099+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session r0wf2m4qhnjd, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:50724]
2023-08-21 14:20:24.268944+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [UDP, session r0wf2m4qhnjd, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:50724, relay 65.108.215.1:65142]
[WARN] [86600116291243] Failed to add some remote candidates (added 0, expected 1)
mcu_janus.go:864: Publisher 149239495294434 received connected
2023-08-21 14:20:24.289028+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session iuoeq4ozxw7b, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:40463]
2023-08-21 14:20:24.289278+02:00 [info] Refreshing TURN permission for 172.20.0.3 [UDP, session a294u8v2dgxk, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:40463, relay 65.108.215.1:50973]
2023-08-21 14:20:24.289362+02:00 [info] Binding TURN channel 4000 for peer 172.20.0.3:47836 [UDP, session a294u8v2dgxk, user 1692706822:GlLpdNUQOzZqm0oa, client 89.245.211.82:40463, relay 65.108.215.1:50973]
2023-08-21 14:20:24.308946+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session j3hio37df0vl, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:50724]
2023-08-21 14:20:24.309202+02:00 [info] Creating TURN permission for 172.20.0.3 [UDP, session r0wf2m4qhnjd, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:50724, relay 65.108.215.1:65142]
[WARN] [5427407491212957] Failed to add some remote candidates (added 0, expected 1)
mcu_janus.go:1107: Subscriber 86600116291243 received connected
2023-08-21 14:20:43.187960+02:00 [info] Accepting connection: [::1]:59438 -> [::1]:3478 [TCP, session 7xko7f6v4gwv]
2023-08-21 14:20:43.195600+02:00 [info] Accepting connection: 172.20.0.1:48390 -> 172.20.0.3:3478 [TCP, session iwsga8nkmrsv]
[ERR] [dtls.c:janus_dtls_retry:1150] [5427407491212957] DTLS taking too much time for component 1 in stream 1...
mcu_janus.go:1097: Subscriber 5427407491212957 received hangup (DTLS timeout), closing
janus_client.go:470: Unable to deliver message {
   "janus": "detached",
   "session_id": 4215117486414649,
   "sender": 5427407491212957
}. Handle 5427407491212957 gone?
client.go:282: Client Hx_mCrrRex5shq9z3Nj7kI-NTATdYrhkJRSUHZQ-av58PT1nSDFJMExkbGFLMkFXOXB6VU1pcDV0SW45eVF2WEk1aV9MSHNEenlxLUZhUngyOW9zcFpqUGNrWWVfQjk0ZXloVW1lOW5aZFRXZjVNMmI4cS1fRVR2RUc3UWtrN3k1ZVdKd1dkdnA3MkJKTnROZW9QTFl2S29aZG1vNUFQbGRtRGZ6bE1WZjRkLTF4NDMtdGFWQjhxNUhfTmJUbEctVFMzM1U2OXNMNzJtOXJTX0F8NjE0MDI2Mjk2MQ== has RTT of 44 ms (44.320505ms)
client.go:282: Client ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ== has RTT of 40 ms (40.290278ms)
2023-08-21 14:21:13.412404+02:00 [info] Accepting connection: [::1]:53034 -> [::1]:3478 [TCP, session 40vjt2x5yltu]
2023-08-21 14:21:13.418661+02:00 [info] Accepting connection: 172.20.0.1:60592 -> 172.20.0.3:3478 [TCP, session dwu1f71b1tzc]
2023-08-21 14:21:43.190164+02:00 [info] Connection timed out [TCP, session 7xko7f6v4gwv, anonymous, client [::1]:59438]
2023-08-21 14:21:43.196946+02:00 [info] Connection timed out [TCP, session iwsga8nkmrsv, anonymous, client 172.20.0.1:48390]
2023-08-21 14:21:43.597458+02:00 [info] Accepting connection: [::1]:41840 -> [::1]:3478 [TCP, session 0ukgp4r3oefr]
2023-08-21 14:21:43.603594+02:00 [info] Accepting connection: 172.20.0.1:39342 -> 172.20.0.3:3478 [TCP, session 21o237foq3ty]
client.go:282: Client Hx_mCrrRex5shq9z3Nj7kI-NTATdYrhkJRSUHZQ-av58PT1nSDFJMExkbGFLMkFXOXB6VU1pcDV0SW45eVF2WEk1aV9MSHNEenlxLUZhUngyOW9zcFpqUGNrWWVfQjk0ZXloVW1lOW5aZFRXZjVNMmI4cS1fRVR2RUc3UWtrN3k1ZVdKd1dkdnA3MkJKTnROZW9QTFl2S29aZG1vNUFQbGRtRGZ6bE1WZjRkLTF4NDMtdGFWQjhxNUhfTmJUbEctVFMzM1U2OXNMNzJtOXJTX0F8NjE0MDI2Mjk2MQ== has RTT of 43 ms (43.556459ms)
client.go:282: Client ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ== has RTT of 40 ms (40.002699ms)
2023-08-21 14:22:13.413981+02:00 [info] Connection timed out [TCP, session 40vjt2x5yltu, anonymous, client [::1]:53034]
2023-08-21 14:22:13.420833+02:00 [info] Connection timed out [TCP, session dwu1f71b1tzc, anonymous, client 172.20.0.1:60592]
2023-08-21 14:22:13.812584+02:00 [info] Accepting connection: [::1]:56184 -> [::1]:3478 [TCP, session 9ewpsjpbehaw]
2023-08-21 14:22:13.815128+02:00 [info] Connection reset by peer [TCP, session 9ewpsjpbehaw, anonymous, client [::1]:56184]
2023-08-21 14:22:13.820754+02:00 [info] Accepting connection: 172.20.0.1:51000 -> 172.20.0.3:3478 [TCP, session 5hdu13u01ux1]

szaimen · 2023-08-21T12:28:24Z

If I read the problem correctly, the following seems to be the issue:

Accepting connection: [::1]:53034 -> [::1]:3478
Accepting connection: 172.20.0.1:60592 -> 172.20.0.3:3478

It seems like eturnal is not getting the correct ip-address of the android talk app?

szaimen · 2023-08-21T12:34:19Z

But this is weird because the browser on the other end of the connection seems to be correctly recognized:

Accepting connection: 89.245.211.82:37157 -> 172.20.0.3:3478

sando38 · 2023-08-21T16:16:17Z

These two eturnal log lines show the external client, which I guess it the IP address of your android talk app.

2023-08-21 14:20:21.620117+02:00 [info] Accepting connection: 89.245.211.82:64163 -> 172.20.0.3:3478 [TCP, session w9m65sygz43v]
2023-08-21 14:20:21.628585+02:00 [info] Accepting connection: 89.245.211.82:64167 -> 172.20.0.3:3478 [TCP, session f0zhb8rr4fgx]

Now TURN allocations/sessions are created for the client 89.245.211.82.

2023-08-21 14:20:21.662015+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session w9m65sygz43v, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64163]
2023-08-21 14:20:21.663669+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [TCP, session w9m65sygz43v, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64163, relay 65.108.215.1:57188]
2023-08-21 14:20:21.728808+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session f0zhb8rr4fgx, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64167]
2023-08-21 14:20:21.730421+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [TCP, session f0zhb8rr4fgx, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64167, relay 65.108.215.1:54496]
[WARN] [6615153529480378] Failed to add some remote candidates (added 0, expected 1)
2023-08-21 14:20:21.754141+02:00 [info] Accepting long-term STUN/TURN authentication [TCP, session w9m65sygz43v, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64163]
2023-08-21 14:20:21.754361+02:00 [info] Creating TURN permission for 172.20.0.3 [TCP, session w9m65sygz43v, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64163, relay 65.108.215.1:57188]
room.go:656: Session ZMXGCly83B4aLQ0Ooi8upP1Xs0t7f-Dv__v0AGklwIp8PT13bEYzcmI4b2hTU1Zqa2hkWHZQTWJ3TktoNXFRTU5nQmhfLVRvajRIbEFZYnM5RTFaeGVPNXlhWFZySmljX3RVSG41QjJ6S2lKWndxcExnd0NFVFloM1c2T05ZQzhock9OQmpmZmtBSWhCSWhjWllFNTZNNy1zWnkzckZxRGprcHU0a21GTmpWY1pKR3RFZnl0N2EwVzNPbEVSMWdyUmQzckNHdVd4cXltMUdTNDB8ODE0MDI2Mjk2MQ== joined call 7mwakygo
mcu_janus.go:864: Publisher 6615153529480378 received connected
[WARN] [6615153529480378] Not video and not audio? dropping (SSRC 1802338683)...
[WARN] [6615153529480378] Not video and not audio? dropping (SSRC 2802411147)...
2023-08-21 14:20:22.177248+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session 3nci8r962ljm, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64412]
2023-08-21 14:20:22.178681+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [UDP, session 3nci8r962ljm, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64412, relay 65.108.215.1:49799]
2023-08-21 14:20:22.319290+02:00 [info] Accepting long-term STUN/TURN authentication [UDP, session rkwnwweupiml, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64416]
2023-08-21 14:20:22.321410+02:00 [notice] Creating TURN allocation (lifetime: 599 seconds) [UDP, session rkwnwweupiml, user 1692706817:rsZ6Yn30Vpb0B/2Q, client 89.245.211.82:64416, relay 65.108.215.1:59864]

So from eturnal's point of view, it looks okay.

This seems to be some networking topic in the end, but we will find out :)

What component is 172.20.0.1?
I think 172.20.0.3 is eturnal's internal IP address. The container itself also contains the talk component?
Is 65.108.215.1 reachable on the relay port range 49152-65535 ?
What ports have you published with your docker compose or docker run or do you run --network=host?
Can you tell me tell me the current relay IP address of your working setup?

szaimen · 2023-08-21T16:25:52Z

What component is 172.20.0.1?

It is the ipv4-address of the gateway of the nextcloud-aio network in which all AIO containers are.

I think 172.20.0.3 is eturnal's internal IP address. The container itself also contains the talk component?

yes, it is the ipv4-address of the nextcloud-aio-talk container which also includes the talk components

Is 65.108.215.1 reachable on the relay port range 49152-65535 ?

You mean if these ports are open on the server? I suppose not as only port 3478/tcp and 3478/udp is published from the container on the host...

What ports have you published with your docker compose or docker run or do you run --network=host?

port 3478/udp and 3478/tcp

Can you tell me tell me the current relay IP address of your working setup?

It should be 65.108.215.1 and 2a01:4f9:c010:6870::1

sando38 · 2023-08-21T16:41:29Z

What component is 172.20.0.1?

It is the ipv4-address of the gateway of the nextcloud-aio network in which all AIO containers are.

I see. The connection is established every 30s, is this some sort of pinging? I think, that these log entries are not related to the issue though.

Can you tell me tell me the current relay IP address of your working setup?

It should be 65.108.215.1 and 2a01:4f9:c010:6870::1

Here you posted a screenshot:
#2855 (comment)

It shows 172.20.0.4 as IPv4 address relay address. Now it is 65.108.215.1 for IPv4?

szaimen · 2023-08-21T16:45:12Z

Here you posted a screenshot: #2855 (comment)

It shows 172.20.0.4 as IPv4 address relay address. Now it is 65.108.215.1 for IPv4?

Ah you mean from the working setup, sorry I misread. the screenshot that I've posted was the one that coturn automatically figured out. So I suppose it should still be valid... (it should then probably be the ip-address of the talk container itself? Let me test...

65.108.215.1 is the one that is currently used by eternal...

szaimen · 2023-08-21T16:49:58Z

Works 🎉

szaimen · 2023-08-21T16:52:22Z

Fix is in #3217

szaimen · 2023-08-21T16:53:09Z

Thank you very much @sando38 ! :)

szaimen added 2. developing Work in progress enhancement New feature or request dependencies labels Jun 24, 2023

szaimen added this to the next milestone Jun 24, 2023

szaimen mentioned this pull request Jun 24, 2023

publish new images after recent PRs are merged and tested #2844

Closed

35 tasks

szaimen reviewed Jun 24, 2023

View reviewed changes

Containers/talk/Dockerfile Outdated Show resolved Hide resolved

Zoey2936 commented Jun 24, 2023

View reviewed changes

Containers/talk/start.sh Outdated Show resolved Hide resolved

Zoey2936 commented Jun 24, 2023

View reviewed changes

Containers/talk/start.sh Outdated Show resolved Hide resolved

sando38 reviewed Jun 24, 2023

View reviewed changes

Containers/talk/start.sh Show resolved Hide resolved

sando38 reviewed Jun 24, 2023

View reviewed changes

Containers/talk/start.sh Outdated Show resolved Hide resolved

sando38 reviewed Jun 24, 2023

View reviewed changes

Containers/talk/start.sh Outdated Show resolved Hide resolved

Zoey2936 force-pushed the eturnal branch from fa70a90 to 116b35b Compare June 24, 2023 17:03

Zoey2936 requested a review from sando38 June 24, 2023 17:32

Zoey2936 requested a review from szaimen June 24, 2023 17:32

Zoey2936 marked this pull request as ready for review June 24, 2023 17:34

Zoey2936 force-pushed the eturnal branch from 6cfbfc1 to a78ce88 Compare June 24, 2023 17:35

Zoey2936 commented Jun 24, 2023

View reviewed changes

Containers/talk/Dockerfile Outdated Show resolved Hide resolved

Zoey2936 marked this pull request as draft June 24, 2023 17:44

szaimen reviewed Jun 24, 2023

View reviewed changes

Zoey2936 force-pushed the eturnal branch 4 times, most recently from 29f5e31 to bdb9455 Compare June 24, 2023 19:57

sando38 reviewed Jun 25, 2023

View reviewed changes

Containers/talk/start.sh Outdated Show resolved Hide resolved

Zoey2936 commented Jun 25, 2023

View reviewed changes

Containers/talk/start.sh Outdated Show resolved Hide resolved

sando38 reviewed Aug 10, 2023

View reviewed changes

fix sed

d89d0ce

Signed-off-by: Zoey <zoey@z0ey.de>

szaimen added this to the next milestone Aug 10, 2023

szaimen added 3. to review Waiting for reviews and removed 2. developing Work in progress labels Aug 10, 2023

szaimen marked this pull request as ready for review August 10, 2023 14:06

szaimen mentioned this pull request Aug 17, 2023

publish new images after recent PRs are merged and tested #3180

Closed

41 tasks

szaimen reviewed Aug 17, 2023

View reviewed changes

Containers/talk/start.sh Show resolved Hide resolved

szaimen approved these changes Aug 17, 2023

View reviewed changes

szaimen merged commit f1a71ac into main Aug 17, 2023
9 checks passed

delete-merged-branch bot deleted the eturnal branch August 17, 2023 08:58

szaimen mentioned this pull request Aug 17, 2023

talk - improve healthcheck #3188

Merged

szaimen mentioned this pull request Aug 21, 2023

talk - fix eternal relay-ip #3217

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

eturnal #2855

eturnal #2855

Zoey2936 commented Jun 24, 2023 •

edited by szaimen

Loading

Zoey2936 commented Jun 24, 2023

sando38 commented Jun 24, 2023

Zoey2936 commented Jun 24, 2023

Zoey2936 commented Jun 24, 2023

sando38 commented Jun 24, 2023

szaimen left a comment

sando38 left a comment

Zoey2936 commented Aug 10, 2023

szaimen left a comment

sando38 commented Aug 17, 2023

szaimen commented Aug 17, 2023

Zoey2936 commented Aug 18, 2023

sando38 commented Aug 18, 2023

szaimen commented Aug 18, 2023

szaimen commented Aug 18, 2023

szaimen commented Aug 21, 2023

szaimen commented Aug 21, 2023

szaimen commented Aug 21, 2023

sando38 commented Aug 21, 2023 •

edited

Loading

szaimen commented Aug 21, 2023 •

edited

Loading

sando38 commented Aug 21, 2023 •

edited

Loading

szaimen commented Aug 21, 2023

szaimen commented Aug 21, 2023

szaimen commented Aug 21, 2023

szaimen commented Aug 21, 2023

eturnal #2855

eturnal #2855

Conversation

Zoey2936 commented Jun 24, 2023 • edited by szaimen Loading

Zoey2936 commented Jun 24, 2023

sando38 commented Jun 24, 2023

Zoey2936 commented Jun 24, 2023

Zoey2936 commented Jun 24, 2023

sando38 commented Jun 24, 2023

szaimen left a comment

Choose a reason for hiding this comment

sando38 left a comment

Choose a reason for hiding this comment

Zoey2936 commented Aug 10, 2023

szaimen left a comment

Choose a reason for hiding this comment

sando38 commented Aug 17, 2023

szaimen commented Aug 17, 2023

Zoey2936 commented Aug 18, 2023

sando38 commented Aug 18, 2023

szaimen commented Aug 18, 2023

szaimen commented Aug 18, 2023

szaimen commented Aug 21, 2023

szaimen commented Aug 21, 2023

szaimen commented Aug 21, 2023

sando38 commented Aug 21, 2023 • edited Loading

szaimen commented Aug 21, 2023 • edited Loading

sando38 commented Aug 21, 2023 • edited Loading

szaimen commented Aug 21, 2023

szaimen commented Aug 21, 2023

szaimen commented Aug 21, 2023

szaimen commented Aug 21, 2023

Zoey2936 commented Jun 24, 2023 •

edited by szaimen

Loading

sando38 commented Aug 21, 2023 •

edited

Loading

szaimen commented Aug 21, 2023 •

edited

Loading

sando38 commented Aug 21, 2023 •

edited

Loading