Crossing back to the U.S, from Canada needs a passport either way

All visitors crossing from Canada to the U.S, must present a valid passport or enhanced driver’s license — the same rules apply in both directions. Don’t assume you only need ID going into Canada.