Goldstein was born in Miedzyrzec Podlaski, near Terespol in eastern Poland in 1928. In 1939, it had a population of 12,000, of which 75% were Jews.
Nothing is known of Goldstein’s early life, but it is believed that his family perished in the Holocaust.