Thanks for the replies.
Upon closer inspection, the pops are from my active subwoofer and not the speakers, so sorry for the misdirection earlier. My sub is the BK Electronics XLS200 Mk II, and they pop when the Lyngdorf TDAI-1200 is turned on and turned off, sometimes 2 pops when the amp is turned off.
I did switch to a single RCA connecting the amp to the sub instead of dual RCA (previously I did a dual RCA connection since the sub had L and R inputs), and the pop is slightly softer but still there.
My authorized dealer did email Lyngdorf about it and they suggested removing the HDMI connection to my TV and making sure all components are on the same power strip. But that did not resolve the issue.
Anyways, now that the pops are softer and not from my speakers but my sub which I think are not as sensitive and fragile, I am inclined to just live with it and deem it as "normal".