I am building something similar. Declarative, deterministic workflows with non-deterministic AI steps seems to be a great combination. In spite of this, I dont see too much market penetration.
By the way, do chat anymore, or have chat built into your system, or you only work with declarative workflows?