Common Design Patterns

• Component instance-per-user (prompt personalization)
• Reusing component instances (dynamic retrieval)
• Caching results to save cost (wrapper around OpenAI LLM)
• Disabled component instances
• Context manager component instances
• Generator UDFs (e.g., for streaming LLM output)