I've changed the fps playback setting to 25 (I think it was 30 by default), but when I hover the cursor over the play button, it shows 30 fps instead of 25:
Thank you for reporting, this is indeed a (small) bug. The tooltip is not being updated, however the frame rate indeed changes.
I'm going to fix this in the next version.