I just managed to built the most recent Matplotlib v3.1.1 on my Jolla phone. It's on OpenRepos. scipy (and thus als pandas and seaborn) will most likely never be available for SailfishOS due to a missing FORTRAN compiler.