Either, the unchanging part of us, the observer, is beyond time and space and lives forever. 

Or, time is not a human construct and we are only here for this lifetime.  But that lifetime is our forever. 

 So, either way, we are good!