make release fail #15808

f0x11 · 2017-08-17T11:56:15Z

imagebuilder fail, but docker run success.

imagebuilder
[root@master origin]# imagebuilder -mount /data/docker/volumes/origin-build-bb040432cbe447a91455318f78d99c4754eeeb51/_data/_output/local/releases/rpms/:/srv/origin-local-release/ images/origin
--> FROM openshift/origin-base
--> COPY system-container/system-container-wrapper.sh /usr/local/bin/
--> COPY system-container/config.json.template system-container/manifest.json system-container/service.template system-container/tmpfiles.template /exports/
--> RUN INSTALL_PKGS="origin" &&     yum --enablerepo=origin-local-release install -y ${INSTALL_PKGS} &&     rpm -V ${INSTALL_PKGS} &&     yum clean all &&     setcap 'cap_net_bind_service=ep' /usr/bin/openshift
Loaded plugins: fastestmirror, ovl
file:///srv/origin-local-release/repodata/repomd.xml: [Errno 14] curl#37 - "Couldn't open file /srv/origin-local-release/repodata/repomd.xml"
Trying other mirror.


 One of the configured repositories failed (OpenShift Origin Release from Local Source),
 and yum doesn't have enough cached data to continue. At this point the only
 safe thing yum can do is fail. There are a few ways to work "fix" this:

     1. Contact the upstream for the repository and get them to fix the problem.

     2. Reconfigure the baseurl/etc. for the repository, to point to a working
        upstream. This is most often useful if you are using a newer
        distribution release than is supported by the repository (and the
        packages for the previous distribution release still work).

     3. Run the command with the repository temporarily disabled
            yum --disablerepo=origin-local-release ...

     4. Disable the repository permanently, so yum won't use it by default. Yum
        will then just ignore the repository until you permanently enable it
        again or use --enablerepo for temporary usage:

            yum-config-manager --disable origin-local-release
        or
            subscription-manager repos --disable=origin-local-release

     5. Configure the failing repository to be skipped, if it is unavailable.
        Note that yum will try to contact the repo. when it runs most commands,
        so will have to try and fail each time (and thus. yum will be be much
        slower). If it is a very temporary problem though, this is often a nice
        compromise:

            yum-config-manager --save --setopt=origin-local-release.skip_if_unavailable=true

failure: repodata/repomd.xml from origin-local-release: [Errno 256] No more mirrors to try.
file:///srv/origin-local-release/repodata/repomd.xml: [Errno 14] curl#37 - "Couldn't open file /srv/origin-local-release/repodata/repomd.xml"
running '/bin/sh -c export "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"; INSTALL_PKGS="origin" &&     yum --enablerepo=origin-local-release install -y ${INSTALL_PKGS} &&     rpm -V ${INSTALL_PKGS} &&     yum clean all &&     setcap 'cap_net_bind_service=ep' /usr/bin/openshift' failed with exit code 1

docker run

[root@master origin]# docker run -it -v /data/docker/volumes/origin-build-bb040432cbe447a91455318f78d99c4754eeeb51/_data/_output/local/releases/rpms/:/srv/origin-local-release/ openshift/origin-base
[root@e4f8112193a9 /]# yum --enablerepo=origin-local-release install origin
Loaded plugins: fastestmirror, ovl
base                                                                                                                                                                  | 3.6 kB  00:00:00
centos-paas-sig-openshift-origin36                                                                                                                                    | 2.9 kB  00:00:00
epel/x86_64/metalink                                                                                                                                                  | 5.7 kB  00:00:00
epel                                                                                                                                                                  | 4.3 kB  00:00:00
extras                                                                                                                                                                | 3.4 kB  00:00:00
origin-local-release                                                                                                                                                  | 2.9 kB  00:00:00
updates                                                                                                                                                               | 3.4 kB  00:00:00
(1/9): base/7/x86_64/group_gz                                                                                                                                         | 155 kB  00:00:00
(2/9): epel/x86_64/group_gz                                                                                                                                           | 170 kB  00:00:00
(3/9): epel/x86_64/updateinfo                                                                                                                                         | 807 kB  00:00:00
(4/9): origin-local-release/primary_db                                                                                                                                | 8.8 kB  00:00:00
(5/9): extras/7/x86_64/primary_db                                                                                                                                     | 191 kB  00:00:00
(6/9): centos-paas-sig-openshift-origin36/primary_db                                                                                                                  |  39 kB  00:00:01
(7/9): epel/x86_64/primary_db                                                                                                                                         | 4.7 MB  00:00:01
(8/9): base/7/x86_64/primary_db                                                                                                                                       | 5.6 MB  00:00:03
(9/9): updates/7/x86_64/primary_db                                                                                                                                    | 7.8 MB  00:00:04
Determining fastest mirrors
 * base: mirrors.btte.net
 * epel: mirrors.tuna.tsinghua.edu.cn
 * extras: mirrors.btte.net
 * updates: mirror.bit.edu.cn
Resolving Dependencies
--> Running transaction check
---> Package origin.x86_64 0:3.6.0-0.rc.0.509.bb04043 will be installed
--> Processing Dependency: origin-clients = 3.6.0-0.rc.0.509.bb04043 for package: origin-3.6.0-0.rc.0.509.bb04043.x86_64
--> Running transaction check
---> Package origin-clients.x86_64 0:3.6.0-0.rc.0.509.bb04043 will be installed
--> Processing Dependency: bash-completion for package: origin-clients-3.6.0-0.rc.0.509.bb04043.x86_64
--> Running transaction check
---> Package bash-completion.noarch 1:2.1-6.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=============================================================================================================================================================================================
 Package                                     Arch                               Version                                               Repository                                        Size
=============================================================================================================================================================================================
Installing:
 origin                                      x86_64                             3.6.0-0.rc.0.509.bb04043                              origin-local-release                              46 M
Installing for dependencies:
 bash-completion                             noarch                             1:2.1-6.el7                                           base                                              85 k
 origin-clients                              x86_64                             3.6.0-0.rc.0.509.bb04043                              origin-local-release                              42 M

Transaction Summary
=============================================================================================================================================================================================
Install  1 Package (+2 Dependent packages)

Total download size: 88 M
Installed size: 637 M
Is this ok [y/d/N]:

[root@master origin]# ls /data/docker/volumes/origin-build-bb040432cbe447a91455318f78d99c4754eeeb51/_data/_output/local/releases/rpms/
origin-3.6.0-0.rc.0.509.bb04043.src.rpm                             origin-local-release.repo
origin-3.6.0-0.rc.0.509.bb04043.x86_64.rpm                          origin-master-3.6.0-0.rc.0.509.bb04043.x86_64.rpm
origin-clients-3.6.0-0.rc.0.509.bb04043.x86_64.rpm                  origin-node-3.6.0-0.rc.0.509.bb04043.x86_64.rpm
origin-clients-redistributable-3.6.0-0.rc.0.509.bb04043.x86_64.rpm  origin-pod-3.6.0-0.rc.0.509.bb04043.x86_64.rpm
origin-cluster-capacity-3.6.0-0.rc.0.509.bb04043.x86_64.rpm         origin-sdn-ovs-3.6.0-0.rc.0.509.bb04043.x86_64.rpm
origin-docker-excluder-3.6.0-0.rc.0.509.bb04043.noarch.rpm          origin-service-catalog-3.6.0-0.rc.0.509.bb04043.x86_64.rpm
origin-dockerregistry-3.6.0-0.rc.0.509.bb04043.x86_64.rpm           origin-tests-3.6.0-0.rc.0.509.bb04043.x86_64.rpm
origin-excluder-3.6.0-0.rc.0.509.bb04043.noarch.rpm                 repodata
origin-federation-services-3.6.0-0.rc.0.509.bb04043.x86_64.rpm      tuned-profiles-origin-node-3.6.0-0.rc.0.509.bb04043.x86_64.rpm

I guess imagebuilder is used to mount files, but it didn't seem to work.

The text was updated successfully, but these errors were encountered:

xiaods · 2017-08-18T16:37:36Z

+1

stevekuznetsov · 2017-08-19T22:15:12Z

@xiaods what version (commit) of imagebuilder are you using?

@smarterclayton is this an imagebuilder issue mounting in? Maybe because the data is in a Docker volume?

smarterclayton · 2017-08-19T23:50:03Z

Which version of docker?

f0x11 · 2017-08-21T02:08:13Z

imagebuilder version

commit c3e2e96f351aa1b355fb90169ec9390b7eff5fc5
Merge: 4ac37bb a873739
Author: Clayton Coleman <[email protected]>
Date:   Fri Jun 2 19:06:16 2017 -0400

docker version

Client:
 Version:      1.12.1
 API version:  1.24
 Go version:   go1.6.3
 Git commit:   23cf638
 Built:
 OS/Arch:      linux/amd64

Server:
 Version:      1.12.1
 API version:  1.24
 Go version:   go1.6.3
 Git commit:   23cf638
 Built:
 OS/Arch:      linux/amd64

stevekuznetsov · 2017-08-22T13:46:07Z

@f0x11 is it possible for you to upgrade to docker-1.12.6?

xiaods · 2017-08-24T07:15:31Z

docker-1.12.6 build failed again.

[root@srymaster3 lhfu]# docker version
Client:
 Version:      1.12.6-cs8
 API version:  1.24
 Go version:   go1.6.4
 Git commit:   880bc7e
 Built:        Wed Feb  8 14:37:51 2017
 OS/Arch:      linux/amd64

Server:
 Version:      1.12.6-cs8
 API version:  1.24
 Go version:   go1.6.4
 Git commit:   880bc7e
 Built:        Wed Feb  8 14:37:51 2017
 OS/Arch:      linux/amd64

stevekuznetsov · 2017-08-24T14:58:03Z

/unassign
/assign @smarterclayton

wanghaoran1988 · 2017-08-29T02:32:15Z

I can build this successfuly with: "make release" on the master branch which are build rpms and images (using imagebuilder)
docker version:

Client:
 Version:         1.12.6
 API version:     1.24
 Package version: docker-1.12.6-32.git88a4867.el7.centos.x86_64
 Go version:      go1.7.4
 Git commit:      88a4867/1.12.6
 Built:           Mon Jul  3 16:02:02 2017
 OS/Arch:         linux/amd64

Server:
 Version:         1.12.6
 API version:     1.24
 Package version: docker-1.12.6-32.git88a4867.el7.centos.x86_64
 Go version:      go1.7.4
 Git commit:      88a4867/1.12.6
 Built:           Mon Jul  3 16:02:02 2017
 OS/Arch:         linux/amd64

smarterclayton · 2017-08-29T02:54:48Z

I think the problem is -cs8 - the redhat packaged versions of docker have many, many backported fixes from newer docker versions, so it's likely that the upstream community edition has a bug (we squashed several race conditions in volume mounts). Newer cs versions may work, but the red hat packages on centos are known good.

xiaods · 2017-08-29T03:34:14Z

@smarterclayton @wanghaoran1988 yeah, it make sense, we got successful sometime with some retry .

xiaods · 2017-08-29T03:34:35Z

i think this issue is resolved.

wanghaoran1988 · 2017-08-29T09:24:31Z

/close

xiaods mentioned this issue Aug 19, 2017

openshift/origin image ships with a broken yum repository #14393

Closed

pweil- added component/internal-tools kind/bug Categorizes issue or PR as related to a bug. priority/P2 labels Aug 22, 2017

pweil- assigned stevekuznetsov Aug 22, 2017

openshift-ci-robot assigned smarterclayton and unassigned stevekuznetsov Aug 24, 2017

openshift-ci-robot assigned wanghaoran1988 Aug 29, 2017

openshift-ci-robot closed this as completed Aug 29, 2017

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

make release fail #15808

make release fail #15808

f0x11 commented Aug 17, 2017

xiaods commented Aug 18, 2017

Uh oh!

stevekuznetsov commented Aug 19, 2017

Uh oh!

smarterclayton commented Aug 19, 2017

Uh oh!

f0x11 commented Aug 21, 2017

Uh oh!

stevekuznetsov commented Aug 22, 2017

Uh oh!

xiaods commented Aug 24, 2017 •

edited

Loading

Uh oh!

stevekuznetsov commented Aug 24, 2017

Uh oh!

wanghaoran1988 commented Aug 29, 2017

Uh oh!

smarterclayton commented Aug 29, 2017

Uh oh!

xiaods commented Aug 29, 2017

Uh oh!

xiaods commented Aug 29, 2017

Uh oh!

wanghaoran1988 commented Aug 29, 2017

Uh oh!

make release fail #15808

make release fail #15808

Comments

f0x11 commented Aug 17, 2017

xiaods commented Aug 18, 2017

Uh oh!

stevekuznetsov commented Aug 19, 2017

Uh oh!

smarterclayton commented Aug 19, 2017

Uh oh!

f0x11 commented Aug 21, 2017

Uh oh!

stevekuznetsov commented Aug 22, 2017

Uh oh!

xiaods commented Aug 24, 2017 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

stevekuznetsov commented Aug 24, 2017

Uh oh!

wanghaoran1988 commented Aug 29, 2017

Uh oh!

smarterclayton commented Aug 29, 2017

Uh oh!

xiaods commented Aug 29, 2017

Uh oh!

xiaods commented Aug 29, 2017

Uh oh!

wanghaoran1988 commented Aug 29, 2017

Uh oh!

xiaods commented Aug 24, 2017 •

edited

Loading