"If the universe is constantly expanding, will the stars at night get dimmer and further between?"

Eventually yes, as the space-time continuum stretches, taking the galaxies farther and farther away from each other, but not anytime soon. Think of it this way: we're here at the best possible time, both for life to flourish, and to observe the rest of the universe!