Go to "Site" > "Media Library". You can see all the media files are listed there. Click on the "eye" icon under the Actions to preview the file.

Here, a video is displayed. Click on the play button to preview the video and when you finish click "close".