bug: failed building go-piper

[mudler]

LocalAI version:
Current CI

Environment, CPU architecture, OS, and Version:

Describe the bug
Seems to be started recently within the CI - while building the container image. Compilation fails with:

 #26 655.6 /usr/local/go/pkg/tool/linux_amd64/link -o $WORK/b001/exe/a.out -importcfg $WORK/b001/importcfg.link -X=runtime.godebugDefault=panicnil=1 -buildmode=exe -buildid=h7hMPg1Dyu87U6l-I3iu/P6-xN_sVDPWnWcq4KpKJ/KXkZZ1XYMeBR6OxAs8WH/h7hMPg1Dyu87U6l-I3iu -extld=g++ $WORK/b001/_pkg_.a
#26 655.9 # github.com/mudler/go-piper/example
#26 655.9 /usr/local/go/pkg/tool/linux_amd64/link: running g++ failed: exit status 1
#26 655.9 /usr/bin/ld: warning: libucd.so, needed by ./piper/build/pi/lib/libespeak-ng.so, not found (try using -rpath or -rpath-link)
#26 655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_ispunct'
#26 655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_properties'
#26 655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_isdigit'
#26 655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_isupper'
#26 655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_isspace'
#26 655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_isalpha'
#26 655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_toupper'
#26 655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_isalnum'
#26 655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_lookup_category'
#26 655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_tolower'
#26 655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_islower'
#26 655.9 collect2: error: ld returned 1 exit status
#26 655.9 
#26 655.9 make[1]: *** [Makefile:32: example/main] Error 1
#26 655.9 make[1]: Leaving directory '/build/sources/go-piper'
#26 655.9 make: *** [Makefile:223: sources/go-piper/libpiper_binding.a] Error 2
#26 ERROR: process "/bin/sh -c make build" did not complete successfully: exit code: 2
------
 > [builder 7/8] RUN make build:
655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_toupper'
655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_isalnum'
655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_lookup_category'
655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_tolower'
655.9 /usr/bin/ld: ./piper/build/pi/lib/libespeak-ng.so: undefined reference to `ucd_islower'
655.9 collect2: error: ld returned 1 exit status
655.9 
655.9 make[1]: *** [Makefile:32: example/main] Error 1
655.9 make[1]: Leaving directory '/build/sources/go-piper'
655.9 make: *** [Makefile:223: sources/go-piper/libpiper_binding.a] Error 2

To Reproduce

Expected behavior

Logs
https://github.com/mudler/LocalAI/actions/runs/7015798457/job/19099206160

Additional context
N/A

[mudler]

cc @M0Rf30 - do you maybe have any idea ? it started just recently, didn't had a closer look yet

[mudler]

pretty sure there is something moving now in the source - maybe some targets when building up espeak is not pinpointing hashes, but checking out main branches of deps

[M0Rf30]

No idea. seems that libucd.so is missing. I found this
rhasspy/piper#286

maybe you switched or upgraded agent distro?

[mudler]

No idea. seems that libucd.so is missing. I found this rhasspy/piper#286

maybe you switched or upgraded agent distro?

nope, not at all - the commit history https://github.com/mudler/LocalAI/commits/master shows it started to fail all of a sudden with unrelated changes. Doesn't look a coincidence that the same failure started yesterday 👀 good catch!

[M0Rf30]

Another detail is that re-building tiny-dream branch with gcc 13 (in tests.yaml) doesn't show this error.
https://github.com/mudler/LocalAI/actions/runs/7021951682/job/19105208740?pr=1283 (as you can see I don't rebased on the very latest master commits)

have to use gcc cause of "Permitting static constexpr variables in constexpr functions" (https://gcc.gnu.org/projects/cxx-status.html)

maybe using gcc13 also in the build stage (that now fails as yours) would do the trick

[M0Rf30]

Ok I know why.
https://github.com/rhasspy/piper-phonemize/blob/master/CMakeLists.txt
calls latest master espeak-ng fork by rhasspy and....

as you can see here
https://github.com/rhasspy/espeak-ng/commits/master

latest commit deals with libucd. so using a fixed reference (70d90003174e19ccc523285800611c8c607e347e) during the piper-phonemize will fix.

In any case this is the actual path for libucd:
build/pi/lib/libucd.so

[mudler]

Thanks @M0Rf30 for the detective work! that's indeed bad - there is also no way to pinpoint that in the CMakefile, so we are back at having to find a workaround until it gets fixed upstream

[M0Rf30]

mudler/go-piper#4
#1357

[mudler]

mudler/go-piper#4 #1357

Thanks! I'm still a bit worried that the CMake points to master, but maybe we can work upstream to get it pinned somehow

Update, opened: rhasspy/piper-phonemize#22