Skip to content
AI Engineer Guide.
midReportedcurated

A video summariser samples one frame every three seconds. A customer summary says an export may not have finished, but the recording shows an Export ready toast. What went wrong, and how do you fix it?

30-second answer

Likely follow-ups

Open a question to rehearse the answer.

How would you decide between denser sampling and scene-change triggering?
  • Compare the shortest event you must catch with the scene-change rate; scene triggering wins when state changes produce visible transitions and fails when the change is a small toast.
  • Measure event recall on the golden set at each strategy, not average frame count, because a cheap strategy that misses the toast is not cheaper.
  • Price the token cost per minute of video, since a fixed 1-second interval is predictable while scene-change bursts are not.
What else in that pipeline could have produced a confident wrong answer?
  • The frame may have contained the toast but preprocessing resized or compressed it until the small text was illegible.
  • The prompt may have implied an answer instead of offering an abstain, so the model described the last visible state as final.
  • The transcript and the frames may disagree, and the pipeline had no rule for resolving the conflict or flagging it.

Red flags

  • Suggests a better prompt without touching the sampling rate
  • Says to send every frame, ignoring token cost and context limits

Concepts this tests

Tags

Source: forwarddeployedprep.com

More in Multimodal, vision & voice