Unexpected app crashes: “hijack: Backend error: Ex

2019-08-02 08:55发布

问题:

app.crash index: 0, reason: CRASHED, exit_description: Instance became unhealthy: hijack: Backend error: Exit status: 500, message: {"Type":"","Message":"no space left on device","Handle":"","ProcessID":""} ; connection: process error: could not find the exitcode file for the process: stat /var/vcap/data/garden/depot/XXX/processes/XXX/exitcode: no such file or directory; connection:

Lately, the above error has been persistently occurring on several apps running in the AppCloud. There is no connection between the apps and the apps are very different with different buildpacks.

Can someone help me or has someone else the same problems?

Setup Example: PHP Webapp deployed with the cloudfoundry php buildpack in Swisscom Application Cloud, the same App twice... one app crashes with the error above and the other app doesn't do the error (so very strange, one is running and one not with the exactly same config/environment), installed HTTPD and PHP with all dependencies in the linux container, Stack cflinuxfs2 (https://github.com/cloudfoundry/cflinuxfs2)

回答1:

We have investigated these crashes and have discovered, that they are due to an issue in our configuration of Cloud Foundry which causes the VMs which host the app containers to run out of iNodes. This then manifests itself with the OS reporting "no space left on device" which is arguably a bit misleading and had us fooled for a while.

We are currently working on a new release which will fix this issue. We plan to deploy this release to production as soon as possible. We will keep you updated via this post.

Update: we have rolled out a new platform release which has fixed the issue. Please check your event logs to confirm this.