There's supposed to be a nice downtown to explore, go see a movie, eat at a local resturaunt. As for Railfanning options, check out the San Joaquin Valley Railroad: http://www.trainweb.org/KernJunction/sjvrgallery.htm
The BNSF and UP go through town, but it makes for much better photographs...