Do I have to fill in all columns on the product import sheet?

No, only the name is mandatory. We recommend setting up a unique SKU number. All other settings are optional.