In addition to his daughter and brother, survivors include two sons, James J. Lacy III of Ocean City and Robert J. Lacy of Baltimore; and another daughter, Rett Lacy of Baltimore. His wife of 57 years, the former Dorothy Callis, died in 2006. A daughter, Joan R. Lacy, died in 2009.