ucb_agentic_ai

Lecture 11: Measuring Agent Capabilities and Anthropic’s RSP

Link to lecture recording on YouTube

Date: 2024-11-25

Speaker: Ben Mann

Speaker’s social profile: Website / Google Scholar / GitHub / LinkedIn / X (Twitter)

Education:

Work:

Notes

History of Anthropic: founded in 2021, completed (in 2022) and launched (in 2023) Claude

Elicitation: try to figure out how to do prompt engineering to get the behavior that is wanted
example: chain-of-thought prompting

Measurement becomes more important when coming to agents, as agents can take action in the real world

[Incomplete, work in progress]

References