Debian Bug report logs - #798778
systemd 226's init.scope breaks docker.io 1.7.1~dfsg1-1.

Toggle useless messages

Message #5 received at submit@bugs.debian.org (full text, mbox, reply):

From: Chris Dukes <chris.dukes.aix+debianbts@gmail.com>

To: Debian Bug Tracking System <submit@bugs.debian.org>

Subject: systemd 226's init.scope breaks docker.io 1.7.1~dfsg1-1.

Date: Sat, 12 Sep 2015 10:37:07 -0400

[Message part 1 (text/plain, inline)]

Package: systemd
Version: 226-1
Severity: critical
Justification: breaks unrelated software

Dear Maintainer,

The true bug is the QA process around systemd.
Ideally the following would have happened.
* The maintainer noted significant changes to how systemd handled system 
  resources.  In this case changes to the control group hierarchy
* The maintainer would have packaged the new version of systemd for release 
  to QA systems only
* The QA systems would vet all tools that used those resources.  In this 
  case docker.io
* Bugs would be opened against all tools with issues indicating they 
  require a version less than the version sent to QA
* A bug would be opened against systemd that the new version breaks those tools
* A bug would be opened against upstream to provide compatibility for broken
  services and set a target for deprecation and removal of that compatibility
* Release the new version of systemd *AFTER* a significant portion of the tools
  had released new versions with the updated requires

My ideal may be in conflict with policy concerning releases to Debian Sid.
However, such an approach should reduce polarization around systemd.


On to the regular bug report.

docker.io was severly broken after upgrading to systemd 226.
This was a side effect of systemd 226 introducing the init.scope
feature to move init to a separate control group.

me@myhost:~/pprj$ docker run -d --name=consul --net=host gliderlabs/consul-server bootstrap
b64355c6035c544558e5364e7171ffec385b65122138a7ce4f1bdff85a07c59b
Error response from daemon: Cannot start container b64355c6035c544558e5364e7171ffec385b65122138a7ce4f1bdff85a07c59b: [8] System error: open /sys/fs/cgroup/cpu,cpuacct/init.scope/system.slice/docker-b64355c6035c544558e5364e7171ffec385b65122138a7ce4f1bdff85a07c59b.scope/cpu.shares: no such file or directory

   * What led up to the situation?
Allowed system to upgrade to systemd 226
   * What exactly did you do (or not do) that was effective (or
     ineffective)?
* Initial assumption was that docker needed to be restarted.  Restarting docker did not resolve issue.
* Second assumption was system state was not good after systemd upgrade, so rebooted.  This did not resolve issue.
* Downgrading to systemd 225 resolved the issue.
* Upgrading to systemd 226 caused the issue to immediately return.


-- Package-specific info:

-- System Information:
Debian Release: stretch/sid
  APT prefers unstable
  APT policy: (500, 'unstable')
Architecture: amd64 (x86_64)

Kernel: Linux 4.1.0-2-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)

Versions of packages systemd depends on:
ii  adduser         3.113+nmu3
ii  libacl1         2.2.52-2
ii  libapparmor1    2.9.2-3
ii  libaudit1       1:2.4.4-1
ii  libblkid1       2.27-1
ii  libc6           2.19-19
ii  libcap2         1:2.24-11
ii  libcap2-bin     1:2.24-11
ii  libcryptsetup4  2:1.6.6-5
ii  libgcrypt20     1.6.3-2
ii  libkmod2        21-1
ii  liblzma5        5.1.1alpha+20120614-2.1
ii  libmount1       2.27-1
ii  libpam0g        1.1.8-3.1
ii  libseccomp2     2.2.3-2
ii  libselinux1     2.3-2+b1
ii  libsystemd0     225-1
ii  mount           2.27-1
ii  sysv-rc         2.88dsf-59.2
ii  udev            226-1
ii  util-linux      2.27-1

Versions of packages systemd recommends:
ii  dbus            1.10.0-2
ii  libpam-systemd  225-1

Versions of packages systemd suggests:
ii  systemd-container  225-1
ii  systemd-ui         3-4

-- no debconf information

[systemd-delta.txt (text/plain, attachment)]

[systemd-analyze-dump.txt (text/plain, attachment)]

[dsh-enabled.txt (text/plain, attachment)]

[fstab (text/plain, attachment)]

Message #14 received at 798778@bugs.debian.org (full text, mbox, reply):

From: Dmitry Smirnov <onlyjob@debian.org>

To: 798778@bugs.debian.org

Subject: Re: #798778 systemd 226's init.scope breaks docker.io 1.7.1~dfsg1-1.

Date: Sun, 13 Sep 2015 17:15:03 +1000

[Message part 1 (text/plain, inline)]

Docker have its own bug report about this problem:

    https://github.com/docker/docker/issues/16256

Suggested workaround is to add

    --exec-opt native.cgroupdriver=cgroupfs

to DOCKER_OPTS in "/etc/default/docker".

-- 
Best wishes,
 Dmitry Smirnov
 GPG key : 4096R/53968D1B

---

The great enemy of the truth is very often not the lie -- deliberate,
contrived and dishonest, but the myth, persistent, persuasive, and
unrealistic. Belief in myths allows the comfort of opinion without the
discomfort of thought.
        -- John F Kennedy

[signature.asc (application/pgp-signature, inline)]

Message #19 received at 798778@bugs.debian.org (full text, mbox, reply):

From: Mathieu Parent <math.parent@gmail.com>

To: 798778@bugs.debian.org

Date: Tue, 6 Oct 2015 14:40:03 +0200

-- 
Mathieu

Message #24 received at 798778@bugs.debian.org (full text, mbox, reply):

From: Martin Pitt <mpitt@debian.org>

To: Chris Dukes <chris.dukes.aix+debianbts@gmail.com>, 798778@bugs.debian.org

Subject: Re: Bug#798778: systemd 226's init.scope breaks docker.io 1.7.1~dfsg1-1.

Date: Fri, 16 Oct 2015 09:03:53 +0200

[Message part 1 (text/plain, inline)]

reassign 798778 docker.io 1.7.1~dfsg1-1
forwarded 798778 https://github.com/docker/docker/issues/16256
thanks

Reassigning to docker, as that needs to be adjusted for the new
/init.scope cgroup layout. At some point we really want to switch to
the unified cgroup hierarchy, and then pid 1 (or anything else) can't
be in the root cgroup any more.

For the record, this also affects LXC/cgmanager, see
https://github.com/lxc/lxc/issues/663 and
https://launchpad.net/bugs/1497420 .

Retroactively it of course would have been better to hold this back
until docker gets fixed. But none of the systemd maintainers use
docker, so we weren't aware of this, sorry! Our QA processes currently
don't include testing docker. If you are  interested in doing this,
please contact me, and I'll show you the tests that we currently run
(mostly the autopkgtests for daily CI, but also some manual ones)
and how to integrate there.

Thanks,

Martin
-- 
Martin Pitt                        | http://www.piware.de
Ubuntu Developer (www.ubuntu.com)  | Debian Developer  (www.debian.org)

[signature.asc (application/pgp-signature, inline)]

Message #41 received at 798778-close@bugs.debian.org (full text, mbox, reply):

From: Tianon Gravi <tianon@debian.org>

To: 798778-close@bugs.debian.org

Subject: Bug#798778: fixed in docker.io 1.8.3~ds1-2

Date: Wed, 04 Nov 2015 09:20:13 +0000

Source: docker.io
Source-Version: 1.8.3~ds1-2

We believe that the bug you reported is fixed in the latest version of
docker.io, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 798778@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Tianon Gravi <tianon@debian.org> (supplier of updated docker.io package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Format: 1.8
Date: Wed, 04 Nov 2015 00:09:02 -0800
Source: docker.io
Binary: docker.io vim-syntax-docker golang-github-docker-docker-dev golang-docker-dev
Architecture: source
Version: 1.8.3~ds1-2
Distribution: unstable
Urgency: medium
Maintainer: Paul Tagliamonte <paultag@debian.org>
Changed-By: Tianon Gravi <tianon@debian.org>
Description:
 docker.io  - Linux container runtime
 golang-docker-dev - Transitional package for golang-github-docker-docker-dev
 golang-github-docker-docker-dev - Externally reusable Go packages included with Docker
 vim-syntax-docker - Docker container engine - Vim highlighting syntax files
Closes: 798778 799087
Changes:
 docker.io (1.8.3~ds1-2) unstable; urgency=medium
 .
   * Move "overlay" higher in priority (Closes: #799087)
   * Adjust "native.cgroupdriver" to default to "cgroupfs" (Closes: #798778)
Checksums-Sha1:
 be56b21f9d9a1649e3c5897d841bb36b5538d1a9 4821 docker.io_1.8.3~ds1-2.dsc
 ee599e87a17bf8ea7731718f759d6f28dfaa3214 21308 docker.io_1.8.3~ds1-2.debian.tar.xz
Checksums-Sha256:
 bb020b2297d4117126ef133f531f614e5a6c63fb68a2fe37bc8202cdd670bea9 4821 docker.io_1.8.3~ds1-2.dsc
 dd33638bf86e417913c8e89f7928d3341a2172ee371df750fe38d1d3cbda942d 21308 docker.io_1.8.3~ds1-2.debian.tar.xz
Files:
 bc6a42697c257954698e363ae11cda5c 4821 admin optional docker.io_1.8.3~ds1-2.dsc
 30d0c1db9b0e8d5f99d67761bb580f87 21308 admin optional docker.io_1.8.3~ds1-2.debian.tar.xz

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1

iQIcBAEBCgAGBQJWOb1uAAoJEANqnCW/NX3UEpAP/1OZehp5GO8OlhmVEaMHkZO4
L5dbRvZ+SBc++y72gKnubjkwjgBGW+wkfKNZdjzyXmeUAAOaYAQBiHzR5V4FZ8yI
UUe39eH41ILgoB2HNDKGb26VfMrGZucmGmkNY4zbuzl4KEI9WPRXXwMDfU5Mu6Ey
mW169/tzL52kJP8NcfFLYN9rPbPwgbATIyHA5wNXc5WsVj3wGNIJxIDuhIa/b2eB
5ZbdQtwPkVzBzCMNbHztMDc6utlFYJNrHAXj8cwb5C1eMnhy7ybrJAS3CrdXmDPT
GW6IZgJZ2oRGbHIwHq8197ZDNuKNJUpmWjS9tj1t9SB2pAiRky6YQH0Th2MjIgao
5YKVr3VUzK8ki/os6ZbTKi7xIzoMcZ2T79IrGf+4Vo2RzWRiqeWj2GOxkuKrAWnE
xk7Zbu4JrcwR0pb5vl6jzB7ELPQzZd/PAKf4j/wLKfE1ylEKQ9JIQ853J1WJETTd
rmcBzm7f+yz55w67vmlxx6MQzqtha7NFV3WmolVTJuPRLbXCmslS5RCygJmheAvX
e3pjN46N+Bin6zk4siicOvqPYB2JALoJ3NcgLLtJlaB2s2IOYXYvDLJqBnLVCu9+
jikqMyKs465bRzrZvnQ/nk8G4KlYBWgN43mbTqgpSu8wTcIcGzP9i86m7M4fLecS
mGeIdmaH5oFMqcLzk0aK
=j8yx
-----END PGP SIGNATURE-----

Send a report that this bug log contains spam.