Is this a component of the final system?
When prototyping towards an ambitious vision, every component of the prototype should be either
- smoothly scalable all the way up to become a component of the final, full-scale system, or else
- should teach you so much about what to build next, so cheaply and quickly, that the component itself going to waste is worth it.
If a component falls in neither category, it's most likely unnecessary effort; perhaps even a distraction.
(The primary exception to this rule is internal tools that help you develop the real thing faster and more cheaply.)
A lot of people are building LLM-powered systems that are not a component of a sustainable long-term vision of a society with cheap, universally accessible, AI systems that will be orders of magnitude more capable and just as good at understanding our intent.