Gross was born in 1928 in Palonk in the Carpathian Mountains which were then in the most easterly part of Czechoslovakia.
His mother was Etta and his father was Hugo. His father was a tailor and Gross was trained to be a tailor. He had three older brothers (Philip, Ben and Bernie), two younger brothers (Bill and Sam) and one sister (Rosalyn).