"If the universe is constantly expanding, will the stars at night get dimmer and further between?"

Yes, eventually, but not anytime soon. Think of it this way: we're here at the best possible time, both for life to flourish, and to observe the rest of the universe!