Project

General

Profile

Bug #4191

vlr.c:762 Trying to dispatch event 1 to non-existent FSM instance!

Added by MPoslusny 13 days ago. Updated 3 days ago.

Status:
In Progress
Priority:
Normal
Assignee:
Category:
-
Target version:
-
Start date:
09/06/2019
Due date:
% Done:

50%

Resolution:

Description

Hello,
I test sysmoBTS 1002 with osmo CN against 35 stations. On the stations is a script that registers and unregisters them into the network in the cycle (and switches between EDGE and LTE technologies).
After about two minutes, this error will appear in the MSC log.

BR
Marek

apt-cache showpkg osmo-msc
Package: osmo-msc
Versions: 
1.5.0 (/var/lib/apt/lists/download.opensuse.org_repositories_network:_osmocom:_latest_xUbuntu%5f18.04_._Packages) (/var/lib/dpkg/status)
 Description Language: 
                 File: /var/lib/apt/lists/download.opensuse.org_repositories_network:_osmocom:_latest_xUbuntu%5f18.04_._Packages
                  MD5: 56b9ef74e5f59bb90af4a5ea954cc999
 Description Language: 
                 File: /var/lib/apt/lists/download.opensuse.org_repositories_network:_osmocom:_latest_xUbuntu%5f18.04_._Packages
                  MD5: 56b9ef74e5f59bb90af4a5ea954cc999

Reverse Depends: 
  osmo-msc-dbg,osmo-msc 1.5.0
  osmo-msc:i386,osmo-msc
Dependencies: 
1.5.0 - osmocom-latest (0 (null)) libasn1c1 (0 (null)) libc6 (2 2.14) libdbi1 (2 0.9.0) libosmo-gsup-client0 (0 (null)) libosmo-mgcp-client6 (0 (null)) libosmo-ranap2 (0 (null)) libosmo-sigtran3 (0 (null)) libosmocore12 (0 (null)) libosmoctrl0 (0 (null)) libosmogsm13 (0 (null)) libosmonetif8 (0 (null)) libosmovty4 (0 (null)) libsctp1 (2 1.0.10+dfsg) libsmpp1 (0 (null)) libtalloc2 (2 2.0.4~git20101213) libdbd-sqlite3 (0 (null)) osmo-msc:i386 (32 (null)) 
Provides: 
1.5.0 - osmo-msc:i386 (= 1.5.0) 
Reverse Provides: 
osmo-msc:i386 1.5.0 (= 1.5.0)
Fri Sep  6 09:44:46 2019 DMSC <0006> msc_a.c:361 msc_a(IMSI-901700000025369:MSISDN-0600000229:TMSI-0x00D6C8C0:GERAN-A-50:LU)[0x5555fd915b80]{MSC_A_ST_RELEASING}: transition to state MSC_A_ST_RELEASING not permitted!
Fri Sep  6 09:44:49 2019 DLGLOBAL <0013> vlr.c:762 Trying to dispatch event 1 to non-existent FSM instance!
Fri Sep  6 09:44:49 2019 DLGLOBAL <0013> backtrace.c:47 backtrace() returned 10 addresses
Fri Sep  6 09:44:49 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmocore.so.12(_osmo_fsm_inst_dispatch+0x2e7) [0x7fd80c52f6a7]
Fri Sep  6 09:44:49 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x58ded) [0x5555fbb76ded]
Fri Sep  6 09:44:49 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x213b3) [0x5555fbb3f3b3]
Fri Sep  6 09:44:49 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmo-gsup-client.so.0(+0x121d) [0x7fd80b2a121d]
Fri Sep  6 09:44:49 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmoabis.so.6(+0x96c4) [0x7fd80a2e96c4]
Fri Sep  6 09:44:49 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmocore.so.12(osmo_select_main+0x227) [0x7fd80c52aef7]
Fri Sep  6 09:44:49 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x1141a) [0x5555fbb2f41a]
Fri Sep  6 09:44:49 2019 DLGLOBAL <0013> backtrace.c:57         /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7fd80aabdb97]
Fri Sep  6 09:44:49 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x11ada) [0x5555fbb2fada]
Fri Sep  6 09:44:54 2019 DMSC <0006> vlr_lu_fsm.c:733 msc_a(TMSI-0xB0FA53F3:GERAN-A-51:LU)[0x5555fd916d00]{MSC_A_ST_RELEASING}: Event MSC_A_EV_CN_CLOSE not permitted
Fri Sep  6 09:44:54 2019 DMSC <0006> msc_a.c:361 msc_a(TMSI-0xB0FA53F3:GERAN-A-51:LU)[0x5555fd916d00]{MSC_A_ST_RELEASING}: transition to state MSC_A_ST_RELEASING not permitted!
Fri Sep  6 09:44:56 2019 DLGLOBAL <0013> vlr.c:762 Trying to dispatch event 1 to non-existent FSM instance!
Fri Sep  6 09:44:56 2019 DLGLOBAL <0013> backtrace.c:47 backtrace() returned 10 addresses
Fri Sep  6 09:44:56 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmocore.so.12(_osmo_fsm_inst_dispatch+0x2e7) [0x7fd80c52f6a7]
Fri Sep  6 09:44:56 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x58ded) [0x5555fbb76ded]
Fri Sep  6 09:44:56 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x213b3) [0x5555fbb3f3b3]
Fri Sep  6 09:44:56 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmo-gsup-client.so.0(+0x121d) [0x7fd80b2a121d]
Fri Sep  6 09:44:56 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmoabis.so.6(+0x96c4) [0x7fd80a2e96c4]
Fri Sep  6 09:44:56 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmocore.so.12(osmo_select_main+0x227) [0x7fd80c52aef7]
Fri Sep  6 09:44:56 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x1141a) [0x5555fbb2f41a]
Fri Sep  6 09:44:56 2019 DLGLOBAL <0013> backtrace.c:57         /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7fd80aabdb97]
Fri Sep  6 09:44:56 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x11ada) [0x5555fbb2fada]
Fri Sep  6 09:45:00 2019 DLGLOBAL <0013> vlr.c:762 Trying to dispatch event 1 to non-existent FSM instance!
Fri Sep  6 09:45:00 2019 DLGLOBAL <0013> backtrace.c:47 backtrace() returned 10 addresses
Fri Sep  6 09:45:00 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmocore.so.12(_osmo_fsm_inst_dispatch+0x2e7) [0x7fd80c52f6a7]
Fri Sep  6 09:45:00 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x58ded) [0x5555fbb76ded]
Fri Sep  6 09:45:00 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x213b3) [0x5555fbb3f3b3]
Fri Sep  6 09:45:00 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmo-gsup-client.so.0(+0x121d) [0x7fd80b2a121d]
Fri Sep  6 09:45:00 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmoabis.so.6(+0x96c4) [0x7fd80a2e96c4]
Fri Sep  6 09:45:00 2019 DLGLOBAL <0013> backtrace.c:57         /usr/lib/x86_64-linux-gnu/libosmocore.so.12(osmo_select_main+0x227) [0x7fd80c52aef7]
Fri Sep  6 09:45:00 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x1141a) [0x5555fbb2f41a]
Fri Sep  6 09:45:00 2019 DLGLOBAL <0013> backtrace.c:57         /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7fd80aabdb97]
Fri Sep  6 09:45:00 2019 DLGLOBAL <0013> backtrace.c:57         osmo-msc(+0x11ada) [0x5555fbb2fada]

History

#1 Updated by neels 3 days ago

Thanks for your report!

Your log transcript starts with "transition to state MSC_A_ST_RELEASING not permitted", but most interesting would be: why did that Release happen?

The non-existing FSM the crash complains about is the auth_fsm. The code path is receiving apparently a GSUP AUTH_INFO_RESULT for a conn that has no auth FSM (anymore?).
Certainly we can easily add a condition that catches this error. But what I really would like to know is: how did this situation come about?

In our tests and "normal" situations, we never encounter this error.
So, to more thoroughly understand why this error happens, and to be able to create a regression test for this:

@MPoslusny , can you reproduce this issue and provide a more complete error log, best even from the startup of osmo-msc up to the error?
If possible, can you also provide a network trace (pcap) of the error?
Thanks!

#2 Updated by neels 3 days ago

  • Status changed from New to In Progress
  • Assignee changed from sysmocom to neels
  • % Done changed from 0 to 50

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 48.8 MB)