The C4DT Factory, together with Dr. Anna Sotnikova from Prof. Antoine Bosselut’s Natural Language Processing lab, is happy to invite you to our upcoming hands-on workshop on LLM evaluation and benchmarking. Our hands-on workshop is designed to demystify LLM benchmarking and provide you with a clear roadmap for your next LLM project.
You will learn:
- benchmarking off-the-shelf LLMs and evaluating the results of fine-tuning a model
- setting up an evaluation strategy and choosing the right benchmark for your particular use-case
- testing your chosen strategy and interpret the results
The event will take place on the 19th of May at EPFL, with the following program:
- 10am-noon – Dr. Anna Sotnikova will give you an introduction to LLM benchmarking, aimed at decision-makers and software engineers.
- 1pm-4:30pm – the C4DT team will guide you through practical exercises on the topic, which is geared to software engineers and their team-leads and product owners.