Me & my boyfriend argue alot!?

Me & my boyfriend argue all the time but, it's when were not together. When we are together we get along so well. I don't no why this is. I've tried speaking to him and we've both agreed that we like each alot but, we can't help bickering about silly things. For example if i misunderstand something he says to me he will get annoyed easily. We don't have really bad arguments but, we argue alot. What should I do? Do you think we should break up?