Do I have to take out the caliper in order to change the brake shoes?

The caliper always seem to move a bit,is this normal? I tryed to tighten the bolts but it seams to reach a point were I can't go further.