Project

General

Profile

Actions
Copy link

Bug #6163

closed

Update distributions in OBS

Added by osmith 8 months ago. Updated 2 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
osmith
Target version:
-
Start date:
08/31/2023
Due date:
% Done:

100%

Spec Reference:

Description

This issue is about making the Linux distributions we build for in OBS more consistent, and ensuring that we don't build for distributions that nobody is using.

Recent package download stats (crawlers filtered out, script, checked out in /root/access-log-stats on downloads.osmocom.org):

Date range:
  04/Jun/2023:00:01:27 +0200 - 31/Aug/2023:14:04:49 +0200

Distributions:
 125453 Debian_11
 124541 CentOS_8
  56912 Debian_12
  47603 Debian_10
  14298 xUbuntu_20.04
   2852 xUbuntu_22.04
   1692 CentOS_7
    681 xUbuntu_18.04
    365 Debian_Unstable
    354 Debian_Testing
     90 xUbuntu_23.04
     47 Debian_9.0
     42 Raspbian_10
     34 xUbuntu_20.10
     15 Raspbian_11
     13 openSUSE_Tumbleweed
Notes:
  • There were a lot of crawlers (search engines, AI companies). I've added a robots.txt disallowing package related directories: https://downloads.osmocom.org/robots.txt
  • EOL distro ubuntu 18.04 has very few downloads, and 21.04 has none. I've removed them from OBS.
  • openSUSE 15.4 has 0 downloads (not listed).
  • I didn't expect Ubuntu 20.04 to get used that much.
Based on the stats above, I think it makes sense to remove:
  • Raspbian 10 and 11 (barely used and debian aarch64 packages can be used instead for newer Pis)
  • openSUSE 15.4, keeping only Tumbleweed (we did not have the latest version 15.5 enabled)

Draft of a new wiki page to list which distros we have enabled, and when to add/remove them:
https://osmocom.org/projects/cellular-infrastructure/wiki/Linux_Distributions

Hide closed

Checklist

  • add latest distros (Rasberry Pi OS 12, Ubuntu 23.10)
  • post news entry about removal of some distros
  • post to mailing lists
  • wait until 2024-02 before removing distros, as announced
  • remove raspberry pi OS 64 bit
  • remove ubuntu 23.04 (will be EOL then)
  • remove openSUSE 15.4
  • remove Debian Testing
Actions
Copy link
 #1

Updated by osmith 8 months ago

libosmocore master was currently not building for ubuntu 20.04, fixed here: https://gerrit.osmocom.org/c/libosmocore/+/34260

Actions
Copy link
 #2

Updated by osmith 8 months ago

  • Status changed from New to Feedback
  • Assignee changed from osmith to laforge
  • % Done changed from 0 to 30

osmith wrote:

Based on the stats above, I think it makes sense to remove:
  • Raspbian 10 and 11 (barely used and debian aarch64 packages can be used instead for newer Pis)
  • openSUSE 15.4, keeping only Tumbleweed (we did not have the latest version 15.5 enabled)

Harald, does this look good? If so, I'd write an announcement that we remove these in 2 months and then remove them.

Actions
Copy link
 #3

Updated by laforge 8 months ago

Agreeing in general, but:

On Thu, Aug 31, 2023 at 12:48:33PM +0000, osmith wrote:

Based on the stats above, I think it makes sense to remove:
  • Raspbian 10 and 11 (barely used and debian aarch64 packages can be used instead for newer Pis)

I would prefer to keep them for armv7l, while abandoning them for aarch64 if we properly document this
so the average user understands how they can use the feeds on aarc64.

Actions
Copy link
 #4

Updated by osmith 8 months ago

Stats generated again, without and with our IPs.

Without our IPs:

Date range:
  04/Jun/2023:00:01:27 +0200 - 31/Aug/2023:16:49:01 +0200

Excluding 17 netmasks:
 375218 lines in
  40390 lines out

Distributions:
  17774 Debian_11
  14298 xUbuntu_20.04
   2852 xUbuntu_22.04
   2295 Debian_12
   1309 Debian_10
    681 xUbuntu_18.04
    354 Debian_Testing
    347 Debian_Unstable
    187 CentOS_8
     90 xUbuntu_23.04
     52 CentOS_7
     47 Debian_9.0
     42 Raspbian_10
     34 xUbuntu_20.10
     15 Raspbian_11
     13 openSUSE_Tumbleweed

With our IPs:

Date range:
  04/Jun/2023:00:01:27 +0200 - 31/Aug/2023:16:50:06 +0200

Distributions:
 125525 Debian_11
 124541 CentOS_8
  57047 Debian_12
  47603 Debian_10
  14298 xUbuntu_20.04
   2852 xUbuntu_22.04
   1711 CentOS_7
    681 xUbuntu_18.04
    365 Debian_Unstable
    354 Debian_Testing
     90 xUbuntu_23.04
     47 Debian_9.0
     42 Raspbian_10
     34 xUbuntu_20.10
     15 Raspbian_11
     13 openSUSE_Tumbleweed

Actions
Copy link
 #5

Updated by Hoernchen 8 months ago

Looks like the non LTS versions of Ubuntu are kinda pointless.. Which is not really surprising, I'm only moving between LTS releases, too.

Actions
Copy link
 #6

Updated by laforge 6 months ago

  • Assignee changed from laforge to osmith
Actions
Copy link
 #7

Updated by osmith 5 months ago

  • Status changed from Feedback to In Progress
Actions
Copy link
 #8

Updated by osmith 5 months ago

  • Checklist item add latest distros (Rasberry Pi OS 12, Ubuntu 23.10) added
  • Checklist item post news entry about removal of some distros added
  • Checklist item post to mailing lists added
  • Checklist item wait until 2024-02 before removing distros, as announced added
  • Checklist item remove raspberry pi OS 64 bit added
  • Checklist item remove ubuntu 23.04 (will be EOL then) added
  • Checklist item remove openSUSE 15.4 added
  • Checklist item remove Debian Testing added
  • % Done changed from 30 to 50

laforge wrote in #note-3:

Agreeing in general, but:

On Thu, Aug 31, 2023 at 12:48:33PM +0000, osmith wrote:

Based on the stats above, I think it makes sense to remove:
  • Raspbian 10 and 11 (barely used and debian aarch64 packages can be used instead for newer Pis)

I would prefer to keep them for armv7l, while abandoning them for aarch64 if we properly document this
so the average user understands how they can use the feeds on aarc64.

Latest_Builds and Nightly_Builds now explain that Raspberry Pi OS users with aarch64 should use the Debian feeds.

I've noticed that openSUSE's OBS also only uses packages from archive.raspbian.org for armv7l, the aarch64 builds of Raspbian use debian feeds.

laforge: I propose the following news entry, is it fine if I post it?

Title: Binary packages: changes in supported distributions

The official Osmocom [[binary packages]] will not be built anymore for
the following distributions starting at 2024-02:

* Raspberry Pi OS 64-bit (use Debian_12 etc. instead)
* Ubuntu 23.04 (Ubuntu 23.10 and LTS 20.04/22.04 feeds are available)
* openSUSE 15.4 (openSUSE Tumbleweed feed is available)
* Debian Testing (Debian Unstable and 12-10 feeds are available)

For Raspberry Pi OS 64-bit users, make sure to adjust your
<code>/etc/apt/sources.list.d</code> as
"described here":https://osmocom.org/projects/cellular-infrastructure/wiki/Latest_Builds
to switch to a Debian aarch64 feed.

See the new "linux distributions":https://osmocom.org/projects/cellular-infrastructure/wiki/Linux_Distributions
article for information on how long we plan to keep building packages for each
distribution.

Additionally I've added Ubuntu 23.10 and Raspberry Pi OS 12 (32 bit), and created a jenkins job that checks whether new Debian, Raspbian or Ubuntu versions have been added to the openSUSE OBS that we don't have yet in our OBS. It fails if that is the case, and so we should be able to consistently add the new versions (and drop e.g. old EOL Ubuntu releases) shortly after they are available in openSUSE OBS:
https://gerrit.osmocom.org/q/topic:update-obs-distros

When the jenkins job fails, it points to this new article describing how to add the new release:
https://osmocom.org/projects/cellular-infrastructure/wiki/Add_a_new_distribution_to_OBS

Actions
Copy link
 #9

Updated by laforge 5 months ago

On Tue, Dec 05, 2023 at 01:22:34PM +0000, wrote:

laforge: I propose the following news entry, is it fine if I post it?

yes, fine with me. Thanks!

Additionally I've added Ubuntu 23.10 and Raspberry Pi OS 12 (32 bit), and created a jenkins job that checks whether new Debian, Raspbian or Ubuntu versions have been added to the openSUSE OBS that we don't have yet in our OBS. It fails if that is the case, and so we should be able to consistently add the new versions (and drop e.g. old EOL Ubuntu releases) shortly after they are available in openSUSE OBS:
https://gerrit.osmocom.org/q/topic:update-obs-distros

excellent.

Actions
Copy link
 #10

Updated by osmith 5 months ago

  • Checklist item post news entry about removal of some distros set to Done
  • Checklist item post to mailing lists set to Done
  • Subject changed from Update distributions in OBS to Update distributions in OBS (wait until 2024-02)
  • Status changed from In Progress to Stalled
  • % Done changed from 50 to 60
Actions
Copy link
 #11

Updated by osmith 3 months ago

  • Checklist item wait until 2024-02 before removing distros, as announced set to Done
  • Checklist item remove raspberry pi OS 64 bit set to Done
  • Checklist item remove ubuntu 23.04 (will be EOL then) set to Done
  • Checklist item remove openSUSE 15.4 set to Done
  • Checklist item remove Debian Testing set to Done
  • Subject changed from Update distributions in OBS (wait until 2024-02) to Update distributions in OBS
  • Status changed from Stalled to In Progress
  • % Done changed from 60 to 90

Distros removed from OBS.

Patch to update osmocom-obs-sync: https://gerrit.osmocom.org/c/osmo-ci/+/35945

Actions
Copy link
 #12

Updated by osmith 2 months ago

  • Status changed from In Progress to Resolved
  • % Done changed from 90 to 100
Actions
Copy link

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 48.8 MB)