Can I walk to the Canadian side attractions from these cheap USA-side hotels?

No, you cannot walk across the border; you must drive or take a taxi/rideshare across the Rainbow Bridge,

Report F000626. Filed.