Though my HVDC power supply is clean and well filtered, I did not observe any false count on my monitor. I have to impose the system on high radiation and see if it still works or gets GM tube noise again.
My problem was that I had simple wiring earlier and everything was fine until 3mR/hr or 450 counts/s, over that it worked well for few minutes and then suddenly a high fixed false pulse count of 4000/s started to come. It fell back to normal when radiation was reduced. I have proper data upto 3mR/hr. I want to measure upto 10mR/hr but the GM tube noise is causing issues. The noise is not from HVDC power supply for sure.