Do I have to fill in all columns on the product import sheet?

No, only the "Name" column is mandatory when importing products.

We also recommend setting up a unique SKU number for every product to keep your catalog organized and make product updates easier.

All other columns on the import sheet are optional.