[SailfishOS] [Announce] Native offline maps: OSM Scout Server - Page 9 - maemo.org

Active Topics

Extra softwares in Sailfish using CLI, repositories, etc (117)
to SailfishOS by nieldk - 17 hrs, 47 mins ago
Firefox with Leste (6)
to Maemo 7 / Leste by teroyk - 1 day, 14 hrs ago
more...

Page 9 of 84

Thread Tools

XOleg	2017-02-04 , 19:20
Posts: 127 \| Thanked: 313 times \| Joined on Sep 2016 @ Yekaterinbourg, Russia	#81

@rinigus
Thanks :-) I downloaded from Mega.

Quote & Reply |

The Following 3 Users Say Thank You to XOleg For This Useful Post:
juiceme, karlos devel, rinigus

XOleg	2017-02-05 , 12:37
Posts: 127 \| Thanked: 313 times \| Joined on Sep 2016 @ Yekaterinbourg, Russia	#82

this works, but...
1. I have for Street,8: Street,8-Street,18-Street,81-Street,181-Street,22/8 etc... It's OK?
2. I request Shop_A, MyCity and I have CityB-MyCity,highway...
3. I have for Shop_B: monument "Shop_B" only(not Shop_B. because names are the same).

I have good answers for alternative method. I tested only for my city, cyrillic, offline maps.

P.S. It's possible to download maps for russian regions from http://gis-lab.info/projects/osm_dump/

Quote & Reply |

The Following 2 Users Say Thank You to XOleg For This Useful Post:
juiceme, rinigus

rinigus	2017-02-05 , 13:37
Posts: 1,414 \| Thanked: 7,547 times \| Joined on Aug 2016 @ Estonia	#83

Originally Posted by XOleg

this works, but...
1. I have for Street,8: Street,8-Street,18-Street,81-Street,181-Street,22/8 etc... It's OK?
2. I request Shop_A, MyCity and I have CityB-MyCity,highway...
3. I have for Shop_B: monument "Shop_B" only(not Shop_B. because names are the same).

I have good answers for alternative method. I tested only for my city, cyrillic, offline maps.

1: In this case it should search for Street* first, and 8* after that. So, I would expect the houses which start with 8, but not 18 and 181. For 22/8, it may have split it into two parts by libpostal normalization, so that could probably happen. Fortunately, I sort it according to the string length => you should get 8 as a first hit. Please verify 18 and 181 houses in your example. If they are there, would be good to get an example which I can specifically test.

2: If the search cannot find a specific reply (judged by resolved number of hierarchies), the result for a search with the latest resolved level dropped is returned. I presume the Shop_A was not found and then it just looked for anything with MyCity.

3: It looks to me that Shops A and B are missing. Let's try to fix it. I presume its due to the fact that these shops are not included in local search database in libosmscout. For fix, I would need their type in OSM.

So, in general, if you miss some POIs in the search, let me know. Find the type as follows:

a. go to http://www.openstreetmap.org
b. find that missing POI, preferably in search
c. see what's its type. For example, for http://www.openstreetmap.org/node/2558987540 its "amenity" "restaurant".
d. let me know about it (github at https://github.com/rinigus/geocoder-nlp or this thread)

I would have to include that by modifying import data type file and regenerate planet databases and push them out.

I presume we would have to do few iterations and let's hope it would stabilize at some point

Originally Posted by XOleg

P.S. It's possible to download maps for russian regions from http://gis-lab.info/projects/osm_dump/

Thank you for suggestion. Its not a problem with getting PBFs - I use geofabrik for that. Its serves whole planet chopped by countries. Problem is mainly how to distribute my databases

I am now regenerating a planet using a newest libosmscout importer that should be able to resolve admin hierarchies much better. As soon as its ready, I'll push it into mega.nz and would update the links.

Quote & Reply |

The Following 3 Users Say Thank You to rinigus For This Useful Post:
Amboss, juiceme, velox

	seiichiro0185	2017-02-06 , 05:21
	Posts: 270 \| Thanked: 610 times \| Joined on Nov 2007 @ Leipzig/Germany	#84

Originally Posted by rinigus

@seiichiro0185, I made a new SQLite database that should speedup the searches. On OPX, the search time for Parkstraße 5 frankfurt dropped from 20+s to 1-2s. There is an additional index in the database for that which made it bigger. I will look into how to reduce the size of it.

Please test whether it works for you. Using the same server code, just get the new database from "testing/europe" subfolder in mega.nz share.

Just did a quick Test with the new sqlite DB and the search is a lot faster now. Searching for the "Parkstraße" address which took 3-4 minutes before now takes about 10 seconds.

I'll test some more and report back if I find anything else

Thanks for your amazing work on this!

__________________
N800 -> N810 -> N900 -> N9 -> Jolla & TOHKBD -> Jolla C -> Xperia X -> XA2 Plus Dual Sim

http://www.seiichiro0185.org

Quote & Reply |

The Following 5 Users Say Thank You to seiichiro0185 For This Useful Post:
Amboss, eekkelund, Jordi, juiceme, rinigus

monkeyisland	2017-02-06 , 06:27
Posts: 191 \| Thanked: 271 times \| Joined on Mar 2015 @ Germany	#85

Hi there is it possible, to integrate german language to Scout Server ?
so that i have german driving instructions with offline support ?

Quote & Reply |

The Following User Says Thank You to monkeyisland For This Useful Post:
juiceme

rinigus	2017-02-06 , 06:44
Posts: 1,414 \| Thanked: 7,547 times \| Joined on Aug 2016 @ Estonia	#86

@seiichiro0185: great to hear that it helped!

I have just uploaded the new version of the geocoder databases to mega.nz. As earlier, please use

http://tiny.cc/geocodernlpdata

since I can change the link after each upload. For tiny.cc-blocking countries, link is

https://mega.nz/#F!1RtTyQwS!r5QDqjwQ...u9Q7Q!8Zt1RaQB

Databases are under geocoder subfolder. Postal part is unchanged.

Changes:

1. Shops are listed. Reported missing by @XOleg, please check if its ok now.

2. I have changed the internal database index and it should search much faster now. That's important for countries like Germany. As a result, database increased a bit in a size, but its probably reasonable compromise.

3. Resolution of admin relationships should be much better than before. So, if there was an error in earlier version, check if its fixed. I expect it to be as good as on http://www.openstreetmap.org, with just few misses (I'll let you find them if you can).

@seiichiro0185, would be great if you could test the speed with the latest version. It should be as fast as the version you had, but the file size is smaller.

Re localization, aka in German, @monkeyisland:

Sure, its possible. Its just German users would have to translate the strings. See https://github.com/rinigus/osmscout-...r/translations for instructions and example translations. I'll be happy to merge PRs with translations.

If someone knows how to setup easier system for users, would be great if you could submit patch with its implementation. Or open an issue and try to give me detailed instructions at https://github.com/rinigus/osmscout-server . The easier it is for me, the faster it would be implemented.

Thank you all for using / testing it!

Last edited by rinigus; 2017-02-07 at 06:56. Reason: Japan and Canada updated as well

Quote & Reply |

The Following 3 Users Say Thank You to rinigus For This Useful Post:
Amboss, juiceme, velox

XOleg	2017-02-06 , 14:29
Posts: 127 \| Thanked: 313 times \| Joined on Sep 2016 @ Yekaterinbourg, Russia	#87

Originally Posted by rinigus

1: In this case it should search for Street* first, and 8* after that. So, I would expect the houses which start with 8, but not 18 and 181. For 22/8, it may have split it into two parts by libpostal normalization, so that could probably happen. Fortunately, I sort it according to the string length => you should get 8 as a first hit. Please verify 18 and 181 houses in your example. If they are there, would be good to get an example which I can specifically test.

2: If the search cannot find a specific reply (judged by resolved number of hierarchies), the result for a search with the latest resolved level dropped is returned. I presume the Shop_A was not found and then it just looked for anything with MyCity.

3: It looks to me that Shops A and B are missing. Let's try to fix it. I presume its due to the fact that these shops are not included in local search database in libosmscout. For fix, I would need their type in OSM.

1. rinigus, excuse me for *8*,but */8 exists. I see *8* for alternative method.

2, 3. It's OK after update.

Thank you for suggestion. Its not a problem with getting PBFs - I use geofabrik for that. Its serves whole planet chopped by countries. Problem is mainly how to distribute my databases

Geofabrik provides for Russia federal districts only. This requires volume... gis-lab provides most of 89 regions separately.

Quote & Reply |

The Following 2 Users Say Thank You to XOleg For This Useful Post:
Amboss, juiceme

rinigus	2017-02-06 , 19:03
Posts: 1,414 \| Thanked: 7,547 times \| Joined on Aug 2016 @ Estonia	#88

Originally Posted by XOleg

1. rinigus, excuse me for *8*,but */8 exists. I see *8* for alternative method.

OK, I see. */8 exists due to the way libpostal normalizes the strings. Its a side effect of allowing to search for streets with the names like Dr. John Smith by using "Smith" in the search string. How to get rid of */8 in response in a general way, I don't know. Since the database is in an open form (SQLite has several tools to work with it) and SQL queries are all in geocoder source code, anyone is welcome to analyse the alternative search commands. Just note that w need to use database indexes to make it fast - otherwise anyone with a bigger country would complain.

Originally Posted by XOleg

Geofabrik provides for Russia federal districts only. This requires volume... gis-lab provides most of 89 regions separately.

I see. Note that I am not distributing the libosmscout maps, just the databases required for geocoding. Libpostal part would be hard to reduce even further by taking smaller part of a country without chopping languages part that I don't have data to do (and probably time either).

SQLite geocoding database would reduce, indeed, if I take these 89 regions. Full Russia is now 720MB. I guess that by dividing it into 9 federal districts should make it reasonable. Don't forget that we have to have ~700MB libpostal dataset already anyway to make it work with the supported languages.

At present, I'll try mainly to work on organizing these databases into a bit of an order first and try to make it simply downloadable. Then I could look into chopping the planet into additional subregions. Surely that would be needed for Germany, Russia, and few others.

Quote & Reply |

The Following 3 Users Say Thank You to rinigus For This Useful Post:
Amboss, juiceme, velox

XOleg	2017-02-07 , 16:18
Posts: 127 \| Thanked: 313 times \| Joined on Sep 2016 @ Yekaterinbourg, Russia	#89

@rinigus
Thanks for huge work

Quote & Reply |

The Following 2 Users Say Thank You to XOleg For This Useful Post:
juiceme, rinigus

rinigus	2017-02-09 , 18:51
Posts: 1,414 \| Thanked: 7,547 times \| Joined on Aug 2016 @ Estonia	#90

I have just published an updated version (0.6.2) which includes German translation - thank you @monkeyisland!

To simplify the work on translations, a project has been opened at https://www.transifex.com/rinigus/osm-scout-server/ . @monkeyisland has been of great help and we tested it on his translation.

In addition, when you ask for a route somewhere by giving the target by name, the calculated route should display the search result under the "Target" message.

Now back to developing it further...