Evidence that the host of GRB 970508 - the first burst with a measured redshift - is a distant dwarf galaxy, tying bursts to faint star-forming hosts.