915 swing weight

I recently added 1 inch to my driver. The swing weight is now D7. In order to get the weight back to D4 would I use heavier or lighter weights in my club head. I currently have the red weight, 9 grams I think.