Singular SPDEs on geometric spaces