A good example might be https://www.nature.com/articles/s41569-020-00435-x which speaks of, primary cardiotropic viruses that can be cleared from the heart … vasculotropic viruses that are likely to have lifelong persistence … lymphotropic viruses with lifelong persistence. They have a later section on coronaviridae but, to my layman's reading, it seems to shrug a bit about what's going on. The article's also over a year old though so maybe we now know more about the prospect of persistence. Your could remains unrebutted but it may yet be that one's body can eradicate SARS-CoV-2 from the heart just as it can, apparently, some other viruses. One wants it cleared from the body wholly though, especially given, These coronaviruses are also suggested to indirectly trigger myocarditis … (emphasis mine).

a special status like neurons — note that SARS-CoV-2 has also been found in brain tissue and seems generally able to infect the CNS. Again, it seems that at least some can be cleared, e.g., https://febs.onlinelibrary.wiley.com/doi/full/10.1111/febs.15871 has, While the majority of CNS infections are successfully cleared by the immune response, some viral infections persist in the CNS, and I've yet to see indication of if SARS-CoV-2 might be one of those, rather than simply leaving lingering damage. My inexpert understanding is that there is immune system activity up there, it's just moderated rather.