How to productionize LLMs: from data prep and prompt design to evaluation, privacy, and future trends like in-context learning.
Dean Pleban and Liron Itzhakhi Allerhand explore what it really takes to move LLMs into production. They cover how to define clear requirements, prep data for RAG, engineer effective prompts, and evaluate model performance using concrete metrics. The conversation dives into managing sensitive data, avoiding leakage, and why crisp outputs and clear user intent matter. Plus: future trends like in-context learning and the decoupling of foundation models from vertical apps.
Watch the video
Listen to the audio
