The nonresidential building dedicated to sexual and domestic violence services went up in flames early Sunday.