Project

General

Profile

Actions

Bug #3767

closed

Most ttcn3-*-test-latest jenkins jobs are failing

Added by osmith about 5 years ago. Updated about 5 years ago.

Status:
Resolved
Priority:
High
Assignee:
Target version:
-
Start date:
01/24/2019
Due date:
% Done:

100%

Spec Reference:

Description

New Osmocom version were released yesterday, and we expected that the -latest jobs would finally reach the same state as the master ones (the ones without a suffix).

However, most tests are still failing for various reasons:
See https://jenkins.osmocom.org/jenkins/view/TTCN3/

This was partially caused by updating eclipse-titan from 6.3.1 to 6.5.0 in the binary package repository, which then meant that our tests were not building anymore (they couldn't find TTCN3.hh anymore). So the testing docker containers were not building anymore, and a following bug in jenkins_common.sh caused the jobs not to abort there, but to continue with the last image that it was able to build (patch to fix that submitted here). The eclipse-titan update was reverted here and now the docker container builds again.

But the problem is not resolved yet, ttcn3-bts-test-latest for example is still failing.

I think daniel mentioned that he saw a "command not found" in the log? I can't find it though.

I will look more into this tomorrow.


Checklist

  • fix ttcn3-hlr-test-latest in my branch
  • fix ttcn3-msc-test-latest in my branch
  • fix ttcn3-sgsn-test-latest in my branch
  • fix ttcn3-sip-test-latest in my branch
  • get changes merged into master
  • fix ttcn3-bts-test-latest in my branch

Related issues

Related to Cellular Network Infrastructure - Bug #3268: execute TTCN3 test suites against "latest" feedsResolvedosmith05/15/2018

Actions
Related to Cellular Network Infrastructure - Bug #3769: docker-playground: RUN_ARGS in Makefile leads to unexpected behaviorRejectedosmith01/28/2019

Actions
Related to Cellular Network Infrastructure - Bug #3771: osmo-msc Debian package does not depend on libdbd-sqlite3Resolvedosmith01/29/2019

Actions
Actions #1

Updated by osmith about 5 years ago

  • Related to Bug #3268: execute TTCN3 test suites against "latest" feeds added
Actions #2

Updated by osmith about 5 years ago

  • Priority changed from Normal to High
Actions #3

Updated by osmith about 5 years ago

Next bug figured out, more to come: ttcn3-bts-test-latest tried to use a non-existing "osmocom-bb-host-master" image.

Patches related to this issue are here:
https://gerrit.osmocom.org/#/q/topic:ttcn3-latest-fixes+(status:open+OR+status:merged)

Actions #4

Updated by osmith about 5 years ago

  • Checklist item ttcn3-hlr-test-latest added
  • Checklist item ttcn3-msc-test-latest added
  • Checklist item ttcn3-sgsn-test-latest added
  • Checklist item ttcn3-sip-test-latest added
Actions #5

Updated by osmith about 5 years ago

I think daniel mentioned that he saw a "command not found" in the log? I can't find it though.

Could be this message from https://jenkins.osmocom.org/jenkins/view/TTCN3/job/ttcn3-hlr-test-latest/96/console:

docker: Error response from daemon: OCI runtime create failed: container_linux.go:348: starting container process caused "exec: \"/usr/local/bin/osmo-hlr\": stat /usr/local/bin/osmo-hlr: no such file or directory": unknown.
Actions #6

Updated by osmith about 5 years ago

  • Checklist item changed from ttcn3-hlr-test-latest to fix ttcn3-hlr-test-latest in my branch
  • Checklist item changed from ttcn3-msc-test-latest to fix ttcn3-msc-test-latest in my branch
  • Checklist item changed from ttcn3-sgsn-test-latest to fix ttcn3-sgsn-test-latest in my branch
  • Checklist item changed from ttcn3-sip-test-latest to fix ttcn3-sip-test-latest in my branch
  • Checklist item get changes merged into master added
  • Checklist item fix ttcn3-hlr-test-latest in my branch set to Done
Actions #7

Updated by osmith about 5 years ago

  • Checklist item fix ttcn3-bts-test-latest in my branch added
Actions #8

Updated by osmith about 5 years ago

  • % Done changed from 0 to 30

It seems like the remaining errors are related to docker containers that are still running on the Jenkins slave, and therefore block spawning of new containers.
I've asked somebody with root access to kill those.

Actions #9

Updated by osmith about 5 years ago

  • Checklist item fix ttcn3-sgsn-test-latest in my branch set to Done
  • Checklist item fix ttcn3-sip-test-latest in my branch set to Done
Actions #10

Updated by osmith about 5 years ago

  • Related to Bug #3769: docker-playground: RUN_ARGS in Makefile leads to unexpected behavior added
Actions #11

Updated by osmith about 5 years ago

  • Related to Bug #3771: osmo-msc Debian package does not depend on libdbd-sqlite3 added
Actions #12

Updated by osmith about 5 years ago

  • Checklist item fix ttcn3-msc-test-latest in my branch set to Done
  • % Done changed from 30 to 90

All -latest tests are running on my branch now!

Now we only need to get the patches merged (review welcome):
https://gerrit.osmocom.org/#/q/topic:ttcn3-latest-fixes+status:open

Actions #13

Updated by osmith about 5 years ago

  • Checklist item get changes merged into master set to Done
  • Status changed from In Progress to Resolved
  • % Done changed from 90 to 100
Actions

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 48.8 MB)