Project

General

Profile

Feature #2538

make jenkins jobs clean up their binaries when done

Added by neels 12 months ago. Updated 5 months ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
-
Target version:
-
Start date:
10/05/2017
Due date:
% Done:

100%

Estimated time:
Spec Reference:

Description

On Osmocombuild1, I noticed that the built binaries remaining in workspaces for matrix builds x concurrent runs can build up considerably.
We should make the jenkins jobs clean up after they are done, for most builds we never actually look at the binaries again.

/home/osmocom-build/jenkins/workspace:
  705M  OpenBSC@7
  826M  osmo-pcu-gerrit
  1.1G  sdk-test-osmo-bts
  1.2G  OpenBSC-gerrit@13
  1.4G  OpenBSC-gerrit
  1.7G  OpenBSC-gerrit@7
  1.7G  osmo-msc-gerrit@7
  1.8G  OpenBSC-gerrit@8
  1.8G  osmo-bts
  1.9G  OpenBSC-gerrit@10
  1.9G  OpenBSC-gerrit@11
  1.9G  OpenBSC-gerrit@12
  1.9G  OpenBSC-gerrit@20
  1.9G  OpenBSC-gerrit@9
  2.0G  OpenBSC-gerrit@2
  2.0G  OpenBSC-gerrit@5
  2.0G  OpenBSC-gerrit@6
  2.0G  osmo-msc-gerrit@2
  2.0G  osmo-msc-gerrit@5
  2.0G  osmo-msc-gerrit@6
  2.1G  OpenBSC-gerrit@3
  2.1G  OpenBSC-gerrit@4
  2.2G  OpenBSC@6
  2.2G  osmo-bts-gerrit
  2.2G  osmo-msc-gerrit@3
  2.2G  osmo-msc-gerrit@4
  2.5G  osmo-msc
  2.6G  OpenBSC@4
  2.7G  OpenBSC@5
  2.8G  osmo-bts-gerrit@2
  3.1G  OpenBSC@2
  3.8G  OpenBSC@3
  6.6G  Sysmocom-Linux-Stable-3.2-tracking
  6.7G  Sysmocom-Linux-Stable-3.10-tracking
  94G total

History

#1 Updated by laforge 7 months ago

  • Assignee set to lynxis

#2 Updated by lynxis 7 months ago

We can enable the cleaning up the workspace on success.

#3 Updated by neels 7 months ago

  • % Done changed from 0 to 50

note that I actually implemented cleanup in most of our jenkins.sh already, just forgot about this issue.
Note invocations to osmo-clean-workspace.sh in the end of most jenkins.sh scripts.
You could still 'du -h' over the jenkins nodes and see which jobs still use a lot of space after they're done...

#4 Updated by lynxis 5 months ago

root@build2-deb9build-ansible:~# du -chs /home/osmocom-build/jenkins/workspace/* 
13M    /home/osmocom-build/jenkins/workspace/gerrit-osmo-hlr
67M    /home/osmocom-build/jenkins/workspace/gerrit-osmo-trx
500K    /home/osmocom-build/jenkins/workspace/master-libgtpnl
1.4M    /home/osmocom-build/jenkins/workspace/master-libosmo-abis
24M    /home/osmocom-build/jenkins/workspace/master-libosmocore
13M    /home/osmocom-build/jenkins/workspace/master-libosmo-netif
18M    /home/osmocom-build/jenkins/workspace/master-libosmo-sccp
4.2M    /home/osmocom-build/jenkins/workspace/master-libtelnet
31M    /home/osmocom-build/jenkins/workspace/master-libusrp
76M    /home/osmocom-build/jenkins/workspace/master-openbsc
46M    /home/osmocom-build/jenkins/workspace/master-osmo-bsc
45M    /home/osmocom-build/jenkins/workspace/master-osmo-bsc@2
505M    /home/osmocom-build/jenkins/workspace/master-osmo-bts
25M    /home/osmocom-build/jenkins/workspace/master-osmocom-bb
33M    /home/osmocom-build/jenkins/workspace/master-osmo-ggsn
4.9M    /home/osmocom-build/jenkins/workspace/master-osmo-gmr
14M    /home/osmocom-build/jenkins/workspace/master-osmo-hlr
86M    /home/osmocom-build/jenkins/workspace/master-osmo-iuh
57M    /home/osmocom-build/jenkins/workspace/master-osmo-mgw
150M    /home/osmocom-build/jenkins/workspace/master-osmo-msc
147M    /home/osmocom-build/jenkins/workspace/master-osmo-msc@2
45M    /home/osmocom-build/jenkins/workspace/master-osmo-msc@3
168M    /home/osmocom-build/jenkins/workspace/master-osmo-pcap
444M    /home/osmocom-build/jenkins/workspace/master-osmo-pcu
123M    /home/osmocom-build/jenkins/workspace/master-osmo-sgsn
122M    /home/osmocom-build/jenkins/workspace/master-osmo-sgsn@2
32M    /home/osmocom-build/jenkins/workspace/master-osmo-sgsn@3
13M    /home/osmocom-build/jenkins/workspace/master-osmo-sip-connector
12M    /home/osmocom-build/jenkins/workspace/master-osmo-tetra
4.2M    /home/osmocom-build/jenkins/workspace/master-osmo-trx
4.0K    /home/osmocom-build/jenkins/workspace/nplab-m3ua-test
4.0K    /home/osmocom-build/jenkins/workspace/nplab-sua-test
268M    /home/osmocom-build/jenkins/workspace/Osmocom_API
4.0K    /home/osmocom-build/jenkins/workspace/Osmocom_API@tmp
800K    /home/osmocom-build/jenkins/workspace/osmocom-coverity
5.2M    /home/osmocom-build/jenkins/workspace/OsmocomDocs
194M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-bsc
89M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-bts
63M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-bts-sysmo
52M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-ggsn
55M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-hlr
83M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-mgw
201M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-msc
216M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-nitb
89M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-pcu
52M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-pcu-sysmo
147M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-sgsn
103M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-stp
75M    /home/osmocom-build/jenkins/workspace/osmo-gsm-tester_build-osmo-trx
444K    /home/osmocom-build/jenkins/workspace/ot290-gsmtap
23M    /home/osmocom-build/jenkins/workspace/ttcn3-bsc-test
158M    /home/osmocom-build/jenkins/workspace/ttcn3-bts-test
2.5M    /home/osmocom-build/jenkins/workspace/ttcn3-mgw-test
4.0K    /home/osmocom-build/jenkins/workspace/ttcn3-msc-test
2.0M    /home/osmocom-build/jenkins/workspace/ttcn3-sgsn-test
808K    /home/osmocom-build/jenkins/workspace/update-osmo-ci-on-slaves
1.5M    /home/osmocom-build/jenkins/workspace/update-osmo-python-on-slaves
4.1G    total

#5 Updated by lynxis 5 months ago

  • Status changed from New to Closed
  • % Done changed from 50 to 100

sight. I can not edit my own comment to remove the doublicated du -hs comment.

It's only 4GB. I think this is fine for now.

#6 Updated by laforge 5 months ago

On Tue, Apr 10, 2018 at 05:02:15PM +0000, lynxis [REDMINE] wrote:

sight. I can not edit my own comment to remove the doublicated du -hs comment.

should work now.

#7 Updated by lynxis 5 months ago

Thanks!

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 48.8 MB)