They aren't leaving you all are just growing old and having different priorities unlike when you were young.
True friends stay the bond would never fade even if you wouldn't see each other so often.
You just need to accept that life gets busier when you grow older, there are so many things that you need to prioritize other than friends, you also need family and job, it wouldn't always be about having fun or hanging out with friends.