Yes, 20’s and early 30’s tanks had riveted armor, and it was even worse than you said, because after hit, even if the armor was not penetrated, the rivets exploded inwards, injuring and killing the crew (iirc italian and japanese tanks were biggest offenders at this in WW2 since most other nations got rid of such tech before WW2).