Not too far away is the Louisville Slugger Museum and Factory and s totally worth checking out! Great experience for all ages. See how the bats are made and even try your luck in the batting cages with famous ballplayers bats.
Even if you do not have time to tour the track, the Kentucky Derby Museum is worth checking out. It is a little pricey at $14, but you are able to take a free walking tour with admission if you choose to. It's newly renovated and have awesome interactive exhibits.