In episode 402 of The Muppet Show, the Prairie Dogs steal Kermit’s collar and he laments that he feels naked without it.

Per the wiki. Surely that explains everything.