This was once a two-story Judges’ Stand. From their high position I imagine the judges would have had a good view of the horses racing, exercising etc.
Scenes from the Trail has a couple of interesting old pictures showing how the judges stand used to look. Well worth a look.
Pictures taken with a Sony A6000. I’m not sure which lens was used.