The area between the points might have to be done some other way. If you want the asphalt effect, a piece of plastic or cardboard can be cut to fit (clear of any flanges and where the points move) and painted to match.
Some places used bricks in these cases as it was easier to maintain the moving bits. This could be modelled with some surplus brick sheet.