The two biggest issues are the splitting of infinitives and whether it's okay to end a sentence with a preposition.
Language purists have long taken umbrage with the Star Trek opening lines: "To boldly go where no man has gone before." They choke, harrumph, and whine over the daringness of breaking the cool lines of the infinitive "To go" by placing 'boldly' between those two words. Hey, you all: it's okay. Split all those infinitives you wish. As a bonus, feel gleefully sinful when you do it.
One day it was on.
The next day it was off.
What happened to happily ever after?
To have her near.
To have her around.
Feelings of remorse and regret came up.
Maybe one day, one day this would all pass by.
Actually, this "rule" came from the notion that English should use similar grammatical rules as Latin. That's a language that is as dead as a doornail. And attempting to follow this rule can lead to awkward sentences.
"Shall I take my clothes off?" sounds better than "Shall off I take my clothes?"