So the update to this is that the wall charger did charger the back to full. I'm not sure what drained the battery in the first place and I'm not sure why the two computers that I tried the USB charging cable didn't work but the USB charging cable is working on the computer with that same battery that got charged with the wall charger.

It is interesting that Nokia says that there is a "not charging" area at around 5V yet the USB cable works, at least it is on this workstation and my home computer.