The kernel now works fine on N9, but, as you said, there is not enough motivation in upstreaming it. IIRC, it seems that many bits depend on closed source user space, and so are probably unsuitable for upstreaming (probably will not be accepted upstream)?
Also, probably the first step to upstream more code is to replace most of N9 board file with device tree equivalant.