I want to store a battery powered device long term (decades) as a reference article, it will never be switched on or charged again. The problem is that it contains a small LiPo battery that will be very hard to remove.

Is there likely to be any significant risk I need to worry about? Once depleted will the battery be relatively inert?