Why are people say I’m sorry once they are caught doing something wrong?

By a certain age people already know and understand right from wrong. (However in my opinion having a disability of the mind can warrant for an excuse) But why do people say I am sorry once they are caught?