This is normal behavior with a 144Hz display. At 144Hz, the higher pixel clock puts more demand on the graphics card, requiring the card to run at standard clock speeds rather than idle clock speeds.

To get around this, in the Windows display settings or the Nvidia Control Panel lower the refresh rate to 120Hz. This will allow for a lower idle clock speed.