The approach is based on Dynamic Time Warping (DTW) applied to cross-attention weights, as demonstrated by this notebook by Jong Wook Kim. … whisper-timestamped is an extension of the openai-whisper Python package and is meant to be compatible with any version of openai-whisper.