Drag & Drop object from any position

I've implemented basic drag and drop into my game using the actor's self.Position.X/Y and game.Mouse.Position.X/Y.
However, when you click, say, the edge of the object, the object center awkwardly jumps to the mouse position. How could I change this so that the point you click on the object moves with the mouse, instead of the object's center?
However, when you click, say, the edge of the object, the object center awkwardly jumps to the mouse position. How could I change this so that the point you click on the object moves with the mouse, instead of the object's center?
Comments
cheers