Tool Calling
Giving LLMs the ability to interact with the world through tools.
Slides
Outline
- (20m) Tool calling
- Explain how tool calling pattern, mostly following https://pkg.garrickadenbuie.com/genAI-2025-llms-meet-shiny
- Activity: quiz show
- We’ve provided an R/Python function that plays a sound
- R:
beepr, Python: playsound
- R:
- Document the function and register it as a tool in the Quiz Show app
- We’ve provided an R/Python function that plays a sound
- (30m) Tool calling UI
- Primarily a series of activities that progressively enhance the quiz show app
- Activity: Add tool annotations to give the tool an icon and title
- Activity: Use
ContentToolResultto return custom title and icon - Activity: Track answers and score in the app (add/update value boxes)