My old accountant suggested putting tax records 10 or more years old into a box in the attic. Not bad. Nowadays I scan everything into the computer and transfer electronically to my accountant and I assume they keep those files awhile for their own protection.
Shredders aren’t that expensive. Mine shreds credit cards and DVDs and ten pages at a time. Type paper shredder into Amazon.