In Lamentations the word goy or ‘nations’ is used. There is no separate reference to ‘pagan’ which suggests that the translators wanted to differentiate it from Isaiah 56:6-7. The ‘nations’ entering the sanctuary was forbidden. During the days of Antiochus Epiphanes, the goyim, the Greeks, entered the sanctuary and defiled it with pig’s blood. Their actions were pagan and they were goyim.
For years I have had similar beliefs and explained to my children, family and friends who consider yoga a wonderful exercise program that it’s roots are in demonic practices. Of course, everyone rolls their eyes at me and considers me a nut case.