The Peristyle was created as a platform for dancing while listening to music performances at the nearby band stand. It was originally called the paristyleum and cost $15,330 when erected in 1907. The dancing platform was designed to match the style of the Anseman Bridge, which was erected in 1903 by the same design firm. The Peristyle was advertized as a "majestic" addition to the park. Dancing at the Peristyle took place from six to eleven thirty at night. Today it is most often used for weddings and photo shoots.

The Peristyle has been renovated several times. The Peristyle once featured an ornate parapet, but it had to be removed due to a leakage problem.