Yes. Usually we use a short piece of thin wire so that it doesn't show so much. The resistance in a short wire isn't bad and there should normally be a few in the adjoining track sections so that there's some parallelism.
There's a much heavier wire under the layout going to the power pack or the control panel.