Using LLMs in a System

When

Wednesday, October 30, 2024

Where

Aldrich 211

Speaker

Jeffrey He · Microsoft (Azure AIOps)

Our second Technical Learning Session covers Using Large Language Models (LLMs) in a System. Jeffrey He (MBA ’26), former product manager on Microsoft’s Azure AIOps team, walks through the task types LLMs excel at (summarizing, inferring, expanding, transforming), prompting techniques (chain-of-thought, few-shot), the trade-offs between GPT o1-preview and GPT-4o, and how to evaluate LLM performance inside a software system. No technical background required.