grow apart

End a friendship or relationship

We were good friends but grew apart after moving.