The shirt fits true to size. So, if size XL always fits you, for example, you should not have any problems with the fit of a size XL Hawaiian shirt. 

When in doubt, however, you should always choose the larger size, as Hawaiian shirts are generally meant to be worn a bit more "breezy."