Removing the bash-color-prompt package removed the customized prompt, the default prompt will now stay in place, and the custom will load after.
This makes the build significantly faster, as podman/buildah has a large processing overhead for commiting each layer, even though I squash them in the end.