How important is the voltage rating for the PTC? I wanted to steer away from surface mount if I can but the radial leaded PTC fuses I am finding are 3A with a 6A trip rated for 30V. Would something like that be safe to use?
The voltage rating indicates the voltage the fuse can tolerate when tripped. PTC fuses don't actually open the circuit when they trip, they transition from very low resistance to a high enough resistance to drop voltage and current down to a low level. Since there is still some current flow when they are tripped, they have to dissipate an amount of power. The larger the package, the more power they can dissipate and the higher the voltage rating.
PTC fuses typically range from 6 to 60 Volts. Since you're using a single cell and will not be going over 4.2V, you should be fine with one as low as 6V. A higher voltage rating is fine if the part is preferable.
You want to pay attention to nominal fuse resistance. You don't want it to be more than 30m Ohms since it can impact booster performance. Running two of the 3A ones in parallel would be better since it cuts insertion resistance in half. It also doubles the trip current, but it's still within tolerance of an IMR 18650.