“quantisation”

fp32, fp16 and int8: What Model Precision Means for Your Cutouts

Fast or Best Quality? The real difference is how many bits each number in the model uses. Here's what fp32, fp16 and int8 do to your cutout's size, speed and edges.