Does this sound TOO casual for a date?

No, this actually sounds perfect. For going on a date with friends at the movies, you don't need to dress up. Just look nice, which your outfit sounds like you will. Have fun :)