Berger was born in Vienna, Austria, in 1933.
Berger was hidden by a local Catholic family and then handed over to the authorities and placed in a home. He was deported to the Theresienstadt ghetto in Czechoslovakia in 1942, when he was nine years old.