The earthly Jerusalem was the place that King David consolidated Israel and its worship.  Later, followers of the Son of David were put out of the Jerusalem temple.  They walked away for a better priesthood.  They walked toward a heavenly Jerusalem (Hebrews 12:22).  They never saw a return to Jerusalem as necessary to worshiping the Father in Spirit and truth (John 4:23-24).  They knew that nothing that could ever happen in the earthly Jerusalem would replace the New Jerusalem coming down from God out of heaven (Revelation 21:1-4).  They knew that Jesus is the Temple of that city and has brought and will bring heaven to earth.

“But you have come to Mount Zion, to the heavenly Jerusalem, the city of the living God. You have come to thousands upon thousands of angels in joyful assembly.” Hebrews 12:22 (NIV)