This study proposes the AR-based information presentation device considering interaction with real objects and virtual objects. The proposed device achieves realistic movement of virtual objects by considering interaction based on laws of physics with real objects and virtual objects. We can intuitively operate the virtual object by using the picking operation acquired from Web camera and markers on fingers as the input device. In the experiment, we made sure that we can operate virtual objects and the proposed device considers interaction with real objects and virtual objects by using proposed device.