Anyone have Puppet Server setup in k8s with CA enabled? having issue

[mababio]

I noticed that some request coming from Puppet agents are having trouble getting their cert signed. a 500 internal error is returned. I think the root of the issue is the /etc/puppetlabs/puppetserver/ca mounted NFS directory. Using Google's FileStore as backend for my PVC. Keep in mind we upgrade from Puppet 7 to Puppet 8. Don't believe we were seeing this issue in out legacy Puppet Server 7 platform. I migrated us to Puppet Server 8 platform and copied over configuration from legacy platform.

Anyone have Open Source Puppet Server residing in GCP? Do you persists your /etc/puppetlabs/puppetserver/ca directory? Are you having any issue with your CA?

snippet of logs:

ERROR [p.r.core] Internal Server Error: java.io.IOException: Stale file handle
INFO 2024-12-03T09:16:28.791484762Z [resource.labels.containerName: puppetserver] 10.20.13.2 - - - 03/Dec/2024:09:16:28 +0000 "PUT /puppet-ca/v1/certificate_request/xxxxxx_12-03-2024 HTTP/1.1" 500 61 10.20.13.2 10.20.13.2 8140 811