Well, theoretically you could get by with just a mobile phone, but writing copy will be so much easier on a computer. It’s one of the very few things new copywriters need to invest in.
Check out these resources for more on the (very minimal) start-up costs for a copywriting business:
How Much Does it Cost to Set Up a Copywriting Business?