Should I buy a wipe warmer?

No.

Room-temperature wipes work fine. Your baby will scream about being cold for approximately three seconds before moving on to screaming about something else. The wipe warmer is just another thing to plug in, clean, and replace the filter on.

Spend the money on diapers instead.