Skip to content

Lab 8: Model Monitoring

By Charles Frye. Published September 14, 2022.

In this lab, we'll add flagging to our ML-powered application so that users can give us feedback.

Then, we'll explore some data logged based on feedback from actual users of the FSDL Text Recognizer to the model monitoring and continual learning platform Gantry.

Outline

  • 00:00 Basic user feedback with gradio
  • 04:51 Logging feedback to Gantry
  • 08:34 Checking for model toxicity with Gantry projections
  • 14:23 Detecting model bugs in the Gantry UI with distributions and filters
  • 19:01 Discovering surprising user data in the Gantry UI
  • 29:53 Outro

We are excited to share this course with you for free.

We have more upcoming great content. Subscribe to stay up to date as we release it.

We take your privacy and attention very seriously and will never spam you. I am already a subscriber