While you can play music on Windows Media Player, its support for different formats is limited. For example, lossless audio formats like APE and MPC aren't compatible.