Cannot run container when `machine init` use custom `image-path` params. #18913

BlackHole1 · 2023-06-16T09:50:43Z

Issue Description

Cannot run container when machine init use custom image-path params.

When I do not pass the image-path argument, Podman will automatically download Fedora CoreOS and can run correctly.

I am building Podman locally using the latest commit: 719e322`.

Steps to reproduce the issue

./bin/darwin/podman --debug machine init oomol --image-path /Users/black-hole/Downloads/fedora-coreos-38.20230609.2.1-qemu.x86_64.qcow2.xz -v /Users:/Users -v /private:/private -v /Applications:/Applications -v /tmp:/tmp
./bin/darwin/podman --debug start machine oomol
./bin/darwin/podman --debug pull busybox
./bin/darwin/podman --debug run -it --rm busybox sh

Describe the results you received

DEBU[0000] ExitCode msg: "preparing container 38512a4000c933e9294673faaa9b5fc4faacb26b54b1b9531d797998470b7f38 for attach: container create failed (no logs from conmon): conmon bytes \"\": readobjectstart: expect { or n, but found \x00, error found in #0 byte of ...||..., bigger context ...||..."
DEBU[0000] DoRequest Method: DELETE URI: http://d/v4.6.0/libpod/containers/38512a4000c933e9294673faaa9b5fc4faacb26b54b1b9531d797998470b7f38
Error: preparing container 38512a4000c933e9294673faaa9b5fc4faacb26b54b1b9531d797998470b7f38 for attach: container create failed (no logs from conmon): conmon bytes "": readObjectStart: expect { or n, but found , error found in #0 byte of ...||..., bigger context ...||...

Describe the results you expected

success run container

podman info output

host:
  arch: amd64
  buildahVersion: 1.30.0
  cgroupControllers:
  - cpu
  - io
  - memory
  - pids
  cgroupManager: systemd
  cgroupVersion: v2
  conmon:
    package: conmon-2.1.7-2.fc38.x86_64
    path: /usr/bin/conmon
    version: 'conmon version 2.1.7, commit: '
  cpuUtilization:
    idlePercent: 94.78
    systemPercent: 3.42
    userPercent: 1.8
  cpus: 1
  databaseBackend: boltdb
  distribution:
    distribution: fedora
    variant: coreos
    version: "38"
  eventLogger: journald
  hostname: localhost.localdomain
  idMappings:
    gidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 100000
      size: 1000000
    uidmap:
    - container_id: 0
      host_id: 502
      size: 1
    - container_id: 1
      host_id: 100000
      size: 1000000
  kernel: 6.3.6-200.fc38.x86_64
  linkmode: dynamic
  logDriver: journald
  memFree: 1278246912
  memTotal: 2048794624
  networkBackend: netavark
  networkBackendInfo:
    backend: ""
    dns: {}
  ociRuntime:
    name: crun
    package: crun-1.8.5-1.fc38.x86_64
    path: /usr/bin/crun
    version: |-
      crun version 1.8.5
      commit: b6f80f766c9a89eb7b1440c0a70ab287434b17ed
      rundir: /run/user/502/crun
      spec: 1.0.0
      +SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +LIBKRUN +WASM:wasmedge +YAJL
  os: linux
  pasta:
    executable: ""
    package: ""
    version: ""
  remoteSocket:
    exists: true
    path: /run/user/502/podman/podman.sock
  security:
    apparmorEnabled: false
    capabilities: CAP_CHOWN,CAP_DAC_OVERRIDE,CAP_FOWNER,CAP_FSETID,CAP_KILL,CAP_NET_BIND_SERVICE,CAP_SETFCAP,CAP_SETGID,CAP_SETPCAP,CAP_SETUID,CAP_SYS_CHROOT
    rootless: true
    seccompEnabled: true
    seccompProfilePath: /usr/share/containers/seccomp.json
    selinuxEnabled: true
  serviceIsRemote: true
  slirp4netns:
    executable: /usr/bin/slirp4netns
    package: slirp4netns-1.2.0-12.fc38.x86_64
    version: |-
      slirp4netns version 1.2.0
      commit: 656041d45cfca7a4176f6b7eed9e4fe6c11e8383
      libslirp: 4.7.0
      SLIRP_CONFIG_VERSION_MAX: 4
      libseccomp: 2.5.3
  swapFree: 0
  swapTotal: 0
  uptime: 0h 10m 43.00s
plugins:
  authorization: null
  log:
  - k8s-file
  - none
  - passthrough
  - journald
  network:
  - bridge
  - macvlan
  - ipvlan
  volume:
  - local
registries:
  search:
  - docker.io
store:
  configFile: /var/home/core/.config/containers/storage.conf
  containerStore:
    number: 0
    paused: 0
    running: 0
    stopped: 0
  graphDriverName: overlay
  graphOptions: {}
  graphRoot: /var/home/core/.local/share/containers/storage
  graphRootAllocated: 106769133568
  graphRootUsed: 2342060032
  graphStatus:
    Backing Filesystem: xfs
    Native Overlay Diff: "true"
    Supports d_type: "true"
    Using metacopy: "false"
  imageCopyTmpDir: /var/tmp
  imageStore:
    number: 1
  runRoot: /run/user/502/containers
  transientStore: false
  volumePath: /var/home/core/.local/share/containers/storage/volumes
version:
  APIVersion: 4.5.1
  Built: 1685123928
  BuiltTime: Sat May 27 01:58:48 2023
  GitCommit: ""
  GoVersion: go1.20.4
  Os: linux
  OsArch: linux/amd64
  Version: 4.5.1



### Podman in a container

No

### Privileged Or Rootless

Rootless

### Upstream Latest Release

No

### Additional environment details

```shell
> qemu-system-x86_64 --version
QEMU emulator version 8.0.0
Copyright (c) 2003-2022 Fabrice Bellard and the QEMU Project developers

Additional information

 ./bin/darwin/podman --debug machine init oomol --image-path /Users/black-hole/Downloads/fedora-coreos-38.20230609.2.1-qemu.x86_64.qcow2.xz -v /Users:/Users -v /private:/private -v /Applications:/Applications -v /tmp:/tmp
INFO[0000] ./bin/darwin/podman filtering at log level debug
DEBU[0000] Using Podman machine with `qemu` virtualization provider
Extracting compressed file
Image resized.
Machine init complete
To start your machine run:

	podman machine start oomol

DEBU[0022] Called machine init.PersistentPostRunE(./bin/darwin/podman --debug machine init oomol --image-path /Users/black-hole/Downloads/fedora-coreos-38.20230609.2.1-qemu.x86_64.qcow2.xz -v /Users:/Users -v /private:/private -v /Applications:/Applications -v /tmp:/tmp)
DEBU[0022] Shutting down engines

./bin/darwin/podman --debug machine start oomol                                                                                                                                                                       
INFO[0000] ./bin/darwin/podman filtering at log level debug
DEBU[0000] Using Podman machine with `qemu` virtualization provider
Starting machine "oomol"
[/usr/local/bin/gvproxy -listen-qemu unix:///var/folders/zm/g19w916x2x36bt16htrwtsh80000gp/T/podman/qmp_oomol.sock -pid-file /var/folders/zm/g19w916x2x36bt16htrwtsh80000gp/T/podman/oomol_proxy.pid -ssh-port 53045 -forward-sock /Users/black-hole/.local/share/containers/podman/machine/qemu/podman.sock -forward-dest /run/user/502/podman/podman.sock -forward-user core -forward-identity /Users/black-hole/.ssh/oomol --debug]
DEBU[0000] qemu cmd: [/Applications/OomolStudio.app/Contents/Resources/container/qemu/bin/qemu-system-x86_64 -m 2048 -smp 1 -fw_cfg name=opt/com.coreos/config,file=/Users/black-hole/.config/containers/podman/machine/qemu/oomol.ign -qmp unix:/var/folders/zm/g19w916x2x36bt16htrwtsh80000gp/T/podman/qmp_oomol.sock,server=on,wait=off -netdev socket,id=vlan,fd=3 -device virtio-net-pci,netdev=vlan,mac=5a:94:ef:e4:0c:ee -device virtio-serial -chardev socket,path=/var/folders/zm/g19w916x2x36bt16htrwtsh80000gp/T/podman/oomol_ready.sock,server=on,wait=off,id=aoomol_ready -device virtserialport,chardev=aoomol_ready,name=org.fedoraproject.port.0 -pidfile /var/folders/zm/g19w916x2x36bt16htrwtsh80000gp/T/podman/oomol_vm.pid -machine q35,accel=hvf:tcg -cpu host -virtfs local,path=/Users,mount_tag=vol0,security_model=none -virtfs local,path=/private,mount_tag=vol1,security_model=none -virtfs local,path=/Applications,mount_tag=vol2,security_model=none -virtfs local,path=/tmp,mount_tag=vol3,security_model=none -drive if=virtio,file=/Users/black-hole/.local/share/containers/podman/machine/qemu/oomol_fedora-coreos-38.20230609.2.1-qemu.x86_64.qcow2 -fw_cfg name=opt/com.coreos/environment,string=ZnRwX3Byb3h5PSJodHRwOi8vMTI3LjAuMC4xOjg4ODgifG5vX3Byb3h5PSJsb2NhbGhvc3QsMTI3LjAuMC4xLGxvY2FsYWRkcmVzcywubG9jYWxkb21haW4uY29tInxGVFBfUFJPWFk9Imh0dHA6Ly8xMjcuMC4wLjE6ODg4OCI=]
Waiting for VM ...
Mounting volume... /Users:/Users
DEBU[0113] Executing: ssh [-i /Users/black-hole/.ssh/oomol -p 53045 core@localhost -o StrictHostKeyChecking=no -o LogLevel=ERROR -o SetEnv=LC_ALL= -q -- sudo chattr -i / ; sudo mkdir -p /Users ; sudo chattr +i / ;]
DEBU[0113] Executing: ssh [-i /Users/black-hole/.ssh/oomol -p 53045 core@localhost -o StrictHostKeyChecking=no -o LogLevel=ERROR -o SetEnv=LC_ALL= -q -- sudo mount -t 9p -o trans=virtio vol0 /Users -o version=9p2000.L,msize=131072]
Mounting volume... /private:/private
DEBU[0114] Executing: ssh [-i /Users/black-hole/.ssh/oomol -p 53045 core@localhost -o StrictHostKeyChecking=no -o LogLevel=ERROR -o SetEnv=LC_ALL= -q -- sudo chattr -i / ; sudo mkdir -p /private ; sudo chattr +i / ;]
DEBU[0114] Executing: ssh [-i /Users/black-hole/.ssh/oomol -p 53045 core@localhost -o StrictHostKeyChecking=no -o LogLevel=ERROR -o SetEnv=LC_ALL= -q -- sudo mount -t 9p -o trans=virtio vol1 /private -o version=9p2000.L,msize=131072]
Mounting volume... /Applications:/Applications
DEBU[0114] Executing: ssh [-i /Users/black-hole/.ssh/oomol -p 53045 core@localhost -o StrictHostKeyChecking=no -o LogLevel=ERROR -o SetEnv=LC_ALL= -q -- sudo chattr -i / ; sudo mkdir -p /Applications ; sudo chattr +i / ;]
DEBU[0115] Executing: ssh [-i /Users/black-hole/.ssh/oomol -p 53045 core@localhost -o StrictHostKeyChecking=no -o LogLevel=ERROR -o SetEnv=LC_ALL= -q -- sudo mount -t 9p -o trans=virtio vol2 /Applications -o version=9p2000.L,msize=131072]
Mounting volume... /tmp:/tmp
DEBU[0115] Executing: ssh [-i /Users/black-hole/.ssh/oomol -p 53045 core@localhost -o StrictHostKeyChecking=no -o LogLevel=ERROR -o SetEnv=LC_ALL= -q -- sudo chattr -i / ; sudo mkdir -p /tmp ; sudo chattr +i / ;]
DEBU[0116] Executing: ssh [-i /Users/black-hole/.ssh/oomol -p 53045 core@localhost -o StrictHostKeyChecking=no -o LogLevel=ERROR -o SetEnv=LC_ALL= -q -- sudo mount -t 9p -o trans=virtio vol3 /tmp -o version=9p2000.L,msize=131072]

This machine is currently configured in rootless mode. If your containers
require root permissions (e.g. ports < 1024), or if you run into compatibility
issues with non-podman clients, you can switch using the following command:

	podman machine set --rootful oomol

API forwarding listening on: /Users/black-hole/.local/share/containers/podman/machine/qemu/podman.sock

The system helper service is not installed; the default Docker API socket
address can't be used by podman. If you would like to install it run the
following commands:

	sudo /Users/black-hole/Code/Job/oomol/podman/podman/bin/darwin/podman-mac-helper install
	podman machine stop oomol; podman machine start oomol

You can still connect Docker API clients by setting DOCKER_HOST using the
following command in your terminal session:

	export DOCKER_HOST='unix:///Users/black-hole/.local/share/containers/podman/machine/qemu/podman.sock'

Machine "oomol" started successfully
DEBU[0116] Called machine start.PersistentPostRunE(./bin/darwin/podman --debug machine start oomol)
DEBU[0116] Shutting down engines

./bin/darwin/podman --debug pull busybox                                                                                                                                                                              
INFO[0000] ./bin/darwin/podman filtering at log level debug
DEBU[0000] Called pull.PersistentPreRunE(./bin/darwin/podman --debug pull busybox)
DEBU[0000] SSH Ident Key "/Users/black-hole/.ssh/oomol" SHA256:IELM/jdsKNns2iXpITpWa57KRJsC0eRhd1UEUkRshkw ssh-ed25519
DEBU[0000] DoRequest Method: GET URI: http://d/v4.6.0/libpod/_ping
DEBU[0000] Loading registries configuration "/etc/containers/registries.conf"
DEBU[0000] Found credentials for ghcr.io in credential helper containers-auth.json in file /Users/black-hole/.config/containers/auth.json
DEBU[0000] No credentials matching docker.io found in /Users/black-hole/.config/containers/auth.json
DEBU[0000] No credentials matching docker.io found in /Users/black-hole/.config/containers/auth.json
DEBU[0000] Found an empty credential entry "https://index.docker.io/v1/" in "/Users/black-hole/.docker/config.json" (an unhandled credential helper marker?), moving on
DEBU[0000] No credentials matching docker.io found in /Users/black-hole/.dockercfg
DEBU[0000] No credentials for docker.io found
DEBU[0000] DoRequest Method: POST URI: http://d/v4.6.0/libpod/images/pull
Resolved "busybox" as an alias (/etc/containers/registries.conf.d/000-shortnames.conf)
Trying to pull docker.io/library/busybox:latest...
Getting image source signatures
Copying blob sha256:71d064a1ac7d46bdcac82ea768aba4ebbe2a05ccbd3a4a82174c18cf51b67ab7
Copying config sha256:b539af69bc01c6c1c1eae5474a94b0abaab36b93c165c0cf30b7a0ab294135a3
Writing manifest to image destination
Storing signatures
b539af69bc01c6c1c1eae5474a94b0abaab36b93c165c0cf30b7a0ab294135a3
DEBU[0004] Called pull.PersistentPostRunE(./bin/darwin/podman --debug pull busybox)
DEBU[0004] Shutting down engines

./bin/darwin/podman --debug run -it --rm busybox sh                                                                                                                                                                   
INFO[0000] ./bin/darwin/podman filtering at log level debug
DEBU[0000] Called run.PersistentPreRunE(./bin/darwin/podman --debug run -it --rm busybox sh)
DEBU[0000] SSH Ident Key "/Users/black-hole/.ssh/oomol" SHA256:IELM/jdsKNns2iXpITpWa57KRJsC0eRhd1UEUkRshkw ssh-ed25519
DEBU[0000] DoRequest Method: GET URI: http://d/v4.6.0/libpod/_ping
DEBU[0000] DoRequest Method: GET URI: http://d/v4.6.0/libpod/networks/pasta/exists
DEBU[0000] Loading registries configuration "/etc/containers/registries.conf"
DEBU[0000] Found credentials for ghcr.io in credential helper containers-auth.json in file /Users/black-hole/.config/containers/auth.json
DEBU[0000] No credentials matching docker.io found in /Users/black-hole/.config/containers/auth.json
DEBU[0000] No credentials matching docker.io found in /Users/black-hole/.config/containers/auth.json
DEBU[0000] Found an empty credential entry "https://index.docker.io/v1/" in "/Users/black-hole/.docker/config.json" (an unhandled credential helper marker?), moving on
DEBU[0000] No credentials matching docker.io found in /Users/black-hole/.dockercfg
DEBU[0000] No credentials for docker.io found
DEBU[0000] DoRequest Method: POST URI: http://d/v4.6.0/libpod/images/pull
DEBU[0000] DoRequest Method: GET URI: http://d/v4.6.0/libpod/images/busybox/json
DEBU[0000] DoRequest Method: POST URI: http://d/v4.6.0/libpod/containers/create
DEBU[0000] Enabling signal proxying
DEBU[0000] Enabling signal proxying
DEBU[0000] DoRequest Method: GET URI: http://d/v4.6.0/libpod/containers/38512a4000c933e9294673faaa9b5fc4faacb26b54b1b9531d797998470b7f38/json
DEBU[0000] DoRequest Method: POST URI: http://d/v4.6.0/libpod/containers/38512a4000c933e9294673faaa9b5fc4faacb26b54b1b9531d797998470b7f38/attach
DEBU[0000] ExitCode msg: "preparing container 38512a4000c933e9294673faaa9b5fc4faacb26b54b1b9531d797998470b7f38 for attach: container create failed (no logs from conmon): conmon bytes \"\": readobjectstart: expect { or n, but found \x00, error found in #0 byte of ...||..., bigger context ...||..."
DEBU[0000] DoRequest Method: DELETE URI: http://d/v4.6.0/libpod/containers/38512a4000c933e9294673faaa9b5fc4faacb26b54b1b9531d797998470b7f38
Error: preparing container 38512a4000c933e9294673faaa9b5fc4faacb26b54b1b9531d797998470b7f38 for attach: container create failed (no logs from conmon): conmon bytes "": readObjectStart: expect { or n, but found , error found in #0 byte of ...||..., bigger context ...||...
DEBU[0000] Shutting down engines

The text was updated successfully, but these errors were encountered:

Luap99 · 2023-06-16T09:55:05Z

Did you only change the image? Because you cannot mount -v /tmp:/tmp, this is know to be broken: #18230

BlackHole1 · 2023-06-16T09:56:02Z

The Fedora CoreOS automatically downloaded by Podman is fedora-coreos-38.20230609.2.1-qemu.x86_64.qcow. And I also used fedora-coreos-38.20230609.2.1-qemu.x86_64.qcow when use image-path.

BlackHole1 · 2023-06-16T09:57:07Z

Did you only change the image? Because you cannot mount -v /tmp:/tmp, this is know to be broken: #18230

Thank you for your reply. I try it for now

BlackHole1 · 2023-06-16T10:56:16Z

@Luap99 Following your advice, we have successfully run. Thank you!

BTW, I would like to know how to obtain detailed logs like the ones you provided in this comment: #18230 (comment)

BlackHole1 added the kind/bug Categorizes issue or PR as related to a bug. label Jun 16, 2023

github-actions bot added the remote Problem is in podman-remote label Jun 16, 2023

BlackHole1 closed this as completed Jun 16, 2023

github-actions bot added the locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. label Sep 15, 2023

github-actions bot locked as resolved and limited conversation to collaborators Sep 15, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Cannot run container when `machine init` use custom `image-path` params. #18913

Cannot run container when `machine init` use custom `image-path` params. #18913

BlackHole1 commented Jun 16, 2023 •

edited

Loading

Luap99 commented Jun 16, 2023

Uh oh!

BlackHole1 commented Jun 16, 2023 •

edited

Loading

Uh oh!

BlackHole1 commented Jun 16, 2023

Uh oh!

BlackHole1 commented Jun 16, 2023

Uh oh!

Cannot run container when machine init use custom image-path params. #18913

Cannot run container when machine init use custom image-path params. #18913

Comments

BlackHole1 commented Jun 16, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Issue Description

Steps to reproduce the issue

Describe the results you received

Describe the results you expected

podman info output

Additional information

Luap99 commented Jun 16, 2023

Uh oh!

BlackHole1 commented Jun 16, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

BlackHole1 commented Jun 16, 2023

Uh oh!

BlackHole1 commented Jun 16, 2023

Uh oh!

Cannot run container when `machine init` use custom `image-path` params. #18913

Cannot run container when `machine init` use custom `image-path` params. #18913

BlackHole1 commented Jun 16, 2023 •

edited

Loading

BlackHole1 commented Jun 16, 2023 •

edited

Loading