I’ve read there is a lot of contention among doctors of whether you should fight a fever or not, with a lot of literature for and against it. My intuition is that, like most symptoms, it is probably best to live with it as best you can without taking meds to reducing it. But if it is causing you to have issues doing activities that will help you recover like sleeping, eating, etc, then to treat it.
It isn’t really used to mean figuratively though. It’s used as an intensifier, and all of its synonyms are as well. And they all have been for hundreds of years. Really, truly, honestly, actually, etc. Seems so strange to me that this is the single word from the group that gets dogpiled on, and the perception that it’s some new phenomenon, Mark Twain used it in the same manner.