Jimmy was born in October 1933 in the family home at Burntisland, the second son of James Stewart (1892-1970) a ship's plater, and Janet Davidson Fyfe (1898-1975). His older brother Bill (born 1929) would get him into much trouble over the years!

To avoid confusion with his father of the same name, he is called "Hamish" (a named which he disliked intensely)