Yes, of course. If you delete css file your theme will break, but removing css will not improve load time. CSS are not too big. Reduce the number of fonts, store them on your server and not at Google. Removing Facebook Like will also reduce load time. With this you can improve load time up to 50%.