Sorry, I do not have a solution for this issue.
It has to do with your own internet connection speed.
It depends on the time your browser loads google fonts.
The “transition” you see is the time taken for the google fonts to apply, if your internet connection is very fast, then you will not notice it.
Alternatively, you can set your google font size close to the size of the original font to minimize the experience.