When this happens to me, I break out my FAT Wrench and check the stock and scope screws.
I was out with my Diana 34 today. I started off on the bench and got the rifle sighted in pretty well. Then I started shooting offhand and noticed my groups shifted substantially low and to the left. Anyone else have those kinds of shifts?