Go to "Site" > "Media Library". You can see all the media files are listed there. Click on the "eye" icon under the Actions to preview the file.
Here, a video is displayed. Click on the play button to preview the video and when you finish click "close".
Also, watch the video on 'Preview our Media in the Media Library