We have succeed with battery-less setup in Maemo Leste. You only need to have 5V connected to MicroUSB port to have device running.
Can you disassebly the battery? Inside the battery you will find a small board connected to the battery cell, just disconnect the cell and connect your power supply to the + and - of that board instead.