Notices


Reply
Thread Tools
Fellfrosch's Avatar
Posts: 455 | Thanked: 1,723 times | Joined on Dec 2009
#471
The previously downloaded maps where already vector maps. There must be a different problem:
If you look inside the federal state Baden Württemberg, there you can download the whole federal state, size nearly 2 GB. But you also can download the further splitted areas which are all together 3,5 GB so it has something to do with the splitting. Maybe because the areas are overlapping.
 

The Following 2 Users Say Thank You to Fellfrosch For This Useful Post:
Posts: 467 | Thanked: 2,199 times | Joined on Aug 2016 @ Estonia
#472
Originally Posted by Fellfrosch View Post
Hi rinigus, How do I download larger areas? I had some older maps on my device and decided to download the new maps. But now I'm quite unsure. Before I had a package "Germany" that was nearly 7 GB. But now Germany is spitted up in different federal states and some of them are even splitted up further. All german maps together would be much more than 20 GB. And I would have to choose a lot of areas seperately. Is that by intend?
I have dropped full Germany and France imports. But *DON'T PANIC*, its still possible to download them and it shouldn't take much more space than before.

Germany and France resulted in huge Mapnik SQLite databases (4GB+) that, due to limitations of FAT FS on SDCards, resulted in periodic questions "why my Germany download doesn't work?". An additional bonus was that it reduced a time of imports by few hours, reduced HDD requirements of the servers as well.

For this convenience on my side, users that want full Germany and France have to get them by regions. So, in your case, you would have to select all subregions (except Berlin which is in some other region as well, if I understood correctly). For Bayern, for example, you could just choose it and there is no need to get all its subregions since they should be all included in it.

Now, the sizes displayed in the menus correspond to the case where it is assumed that you will download only that region. This is to prepare you for the worst-case scenario. Fortunately, the regions in Germany overlap and will share the same data - will be downloaded and stored only once. Let's go through main backends, so you'll get the idea:

* Address parser is given for full country. So, in case of Germany, its 200MB is accounted for in each of the regions

* Geocoder-NLP and OSM Scout are the only backends that don't overlap, but are cut by the border. [technically, there is a minimal overlap, but its not important]

* Mapbox GL and Valhalla are using tiles. If the tile is touching a region, its accounted for in it. Fortunately, tiles are downloaded and unpacked only once.

In your case, you would have to unsubscribe from Germany and subscribe to all its regions. For curiosity, would be good interesting to know current (old schema) and the new disk usage. Note that I pulled Valhalla tiles in somewhat bigger tiles, but I would expect it didn't change much Germany since Valhalla tiles over there were big already before.
 

The Following 10 Users Say Thank You to rinigus For This Useful Post:
pichlo's Avatar
Posts: 5,237 | Thanked: 15,920 times | Joined on Sep 2012 @ UK
#473
Originally Posted by Fellfrosch View Post
The previously downloaded maps where already vector maps. There must be a different problem:
If you look inside the federal state Baden Württemberg, there you can download the whole federal state, size nearly 2 GB. But you also can download the further splitted areas which are all together 3,5 GB so it has something to do with the splitting. Maybe because the areas are overlapping.
That's exactly it. Overlapping. I had a similar problem. Downloading maps for Germany, I had to do that one state at a time. But then the total space taken on the memory card was much smaller than the grand total of all maps added together. When I say much I really mean MUCH. Like less than a half. I remember adding the last one, which alone was supposed to be about 1.5GB, added only about 200MB on the card.
__________________
In particle accelerators atoms are indeed not only touching each others. But banging together in a massive explosive orgasm.
-- nieldk in a TMO post
 

The Following 4 Users Say Thank You to pichlo For This Useful Post:
Fellfrosch's Avatar
Posts: 455 | Thanked: 1,723 times | Joined on Dec 2009
#474
@rinigus thanx for your detailed explanations. I've downloaded all the regions, and am absolutely satisfied. The total space taken doesn't differ to much (less than 500 MB) from the Full Germany download. So everything is fine and I'm totally flashed again by your great work and the ongoing support!!!
 

The Following 7 Users Say Thank You to Fellfrosch For This Useful Post:
pichlo's Avatar
Posts: 5,237 | Thanked: 15,920 times | Joined on Sep 2012 @ UK
#475
Originally Posted by Fellfrosch View Post
The total space taken doesn't differ to much (less than 500 MB) from the Full Germany download.
I expect that to be simply because the maps have grown, not because of the fragmenting. I just updated all my maps (15 areas, including Germany already fragmented before the update) and the total space taken has increased by about 1 GB. I now have only 1 GB left free on a 16 GB SD card

Whilst on the topic, rinigus, would it be possible to update one map at a time? I did not see such an option, I had to update them all in one large go taking a few hours.
__________________
In particle accelerators atoms are indeed not only touching each others. But banging together in a massive explosive orgasm.
-- nieldk in a TMO post
 

The Following 4 Users Say Thank You to pichlo For This Useful Post:
Posts: 467 | Thanked: 2,199 times | Joined on Aug 2016 @ Estonia
#476
Originally Posted by pichlo View Post
Whilst on the topic, rinigus, would it be possible to update one map at a time? I did not see such an option, I had to update them all in one large go taking a few hours.
Not currently and not in my plans. In addition to work that is needed to make it happen, there are issues with the possible database format changes that would interfere with it. I am sure its possible to do, its just there are different priorities for me (geocoder, for example).

I presume it depends on requirements - whether to keep large regions on device or not. Notice, however, that these days we have two servers distributing the maps. So, if one is down, the second takes over. Since switching to two servers, I don't remember any downtime where the both were unavailable. Which makes it reasonable to consider downloading maps just few days before the trip. But that doesn't help if you have to travel constantly, though
 

The Following 9 Users Say Thank You to rinigus For This Useful Post:
pichlo's Avatar
Posts: 5,237 | Thanked: 15,920 times | Joined on Sep 2012 @ UK
#477
Thanks, rinigus. It was just a suggestion, definitely not a priority.

One possible workaround for the user is quite simple. Unsubscribe from all but one, update, subscribe again one at a time.
__________________
In particle accelerators atoms are indeed not only touching each others. But banging together in a massive explosive orgasm.
-- nieldk in a TMO post
 

The Following 2 Users Say Thank You to pichlo For This Useful Post:
Posts: 467 | Thanked: 2,199 times | Joined on Aug 2016 @ Estonia
#478
Originally Posted by pichlo View Post
One possible workaround for the user is quite simple. Unsubscribe from all but one, update, subscribe again one at a time.
That's not going to work. As soon as you accept update, new map definitions are loaded and the old maps are considered out-of-date. So, when you start plugging them back by re-subscribing, you would be doing so for new map version. And you would have to download them.

While you are presented the maps by regions, some backends are imported in one go. For example, Valhalla needs maps from the same import to calculate the routes. Hence, we cannot mix old and new maps. And thinking of it, response to original request - looks to be impossible to update only selected regions if you want to use Valhalla.
 

The Following 5 Users Say Thank You to rinigus For This Useful Post:
pichlo's Avatar
Posts: 5,237 | Thanked: 15,920 times | Joined on Sep 2012 @ UK
#479
Originally Posted by rinigus View Post
That's not going to work. As soon as you accept update, new map definitions are loaded and the old maps are considered out-of-date. So, when you start plugging them back by re-subscribing, you would be doing so for new map version. And you would have to download them.
I know. That was the point. Downloading them one at a time, rather than all 15 in one go.

I should have included one step, purging the cache: Unsubscribe - purge - update - subscribe (and download).
__________________
In particle accelerators atoms are indeed not only touching each others. But banging together in a massive explosive orgasm.
-- nieldk in a TMO post
 

The Following 4 Users Say Thank You to pichlo For This Useful Post:
pichlo's Avatar
Posts: 5,237 | Thanked: 15,920 times | Joined on Sep 2012 @ UK
#480
Originally Posted by peterleinchen View Post
Do you have a more simple way than liberapay (speak paypal) for donations?
I second that. I was just trying to send you a donation but you do not make it exactly easy
__________________
In particle accelerators atoms are indeed not only touching each others. But banging together in a massive explosive orgasm.
-- nieldk in a TMO post
 

The Following 3 Users Say Thank You to pichlo For This Useful Post:
Reply

Tags
offline maps, sailfish os

Thread Tools

 
Forum Jump


All times are GMT. The time now is 10:09.