Just wondering if I would need to pay for something that comes out of the wall, especially if all I have is dial up.

well you still need to pay for the service to get online via dialup, a lot of internet companies do offer pay as you go, so the more you use the more you pay, or you can do a monthly plan, just pay a monthly fee and you can use the internet as much as you want.