thinkwhere

Pre-pre-alpha and so likely to change from day to day, or break, here’s the project I started a while ago and have been working on getting usable, but you should be able to have a play on this sneak peek at least. It’s an open source map georectifier / warper, written in Ruby-on-Rails and using GDAL, Mapserver, and OpenLayers, and it’s provisionally called “Map Warper”. It can be found here: http://wrp.geothings.net

Inspired by Metacarta’s Map Rectifier, which I have written about here and here, it was originally primarily planned to be able to support the WMS plugin I developed for the JOSM editor, and also to assist OpenStreetMap surveyors who collect and want to use their own ground control points. (The other driving force was the desire for me to use some fine out of copyright maps and make a free geodataset of Roman Britain, and historical features in general)

It will have additional features in the near future, such as enabling TileCache for WMS-C/TMS, export to Google style tiles, GeoRSS and KML, amongst other things. As mentioned above, it is still unstable and in active development, so things will change and your data probably will be deleted!

We’re looking for a nice name for it, and a nice logo would be good too!

Where 2.0 has started, alas, I’m not attending in person this year, but Nick Black spotted that my image is there instead, on the conference programme!

Big big thanks to Seero.com who are streaming most of the sessions, plus are archiving a lot of them too if you miss them. Also, the irc backchannel is #where2008 on freenode. The current over-used and misused word is “open”. (last year it was “GeoRSS”).

For live blogging, John Mckerrell is doing exhaustive transcribes too.

Things of note so far:

google includes geosearch in it’s API, and tries to kill Mapufacture. People freak out about augmented reality enhanced police states. Dash opens their API, ESRI and google have a “partnership”. This partnership, basically uses google earth and Arc Server may give a push into good open source / Free Web Processing Servers, as more people see the value of real geographical and spatial analysis, and not wanting to pay tens of thousands for a paleo-program and a new server with ridiculous specs for the privilege.

Japan’s megacities are really 3D - they use the z-axis freely. The urban areas are high density, multiple levels, at high zoom - the cities provide a challenge to cartographers and openstreetmap. And then there are the underground streets!

Consider a normal 16 story tower block. In central London, we can expect these to be offices, no problem mapping these, representing the landuse. In Tokyo, or other large city in Japan, such a building will have multiple uses. Underground (Basement 2) shops and retail units as part of the underground street, leading to subways, still underground, Basement 1 may have restaurants and boutiques. Ground floor (1F) could be the building entrance, possibly a kiosk, bakery of cafe at street level. The remaining floors above ground: a university department, teaching area, library on two floors, three bars on another, restaurants on another. Offices on other floors, nightclub on another. Space is used. But it’s vertical. Even in smaller towns with shorter buildings, multiple uses on each floor is quite common. Signs outside showing whats on each floor are provided - but it’s still a bit weird going up four stories in a lift to a pub!

At the Tokyo micro mapping party at the IPA in Sugamo, we had a look at how openstreetmap can describe buildings. So for example “building:levels = 23″ ; “building:-1 = post_office” “building:1-15 = office”. How these can be shown on a map is another matter.

A few of the new mappers in Tokyo commented how everything around was so dense, there was so much detail, that they wouldn’t want to map everything, as it would become to messy. Perhaps an additional level of zoom for high zoom levels would help here - although it does become too dense for GPS accuracy too - with small shops and restaurants packed up, down and left and right to each other.

The underground streets are quite confusing, a maze, but full of shops, pubs, eateries, people going from office block to subway or train station, from subway to pub, entering an office block at basement level and ascending up to seventh floor, all from under the streets. Not surprisingly, navigation is quite horrid. Maps do exist and are shown frequently (see below). Mobile phones work underground. Theres talk of rfid at exits, one company (Navitime) is selling (expensive) pedestrian navigation for mobile phones, and they include all the underground areas too - this company is heavily advertising on the trains and on TV. Personal pedestrian navigation on a phone…. I wonder how many years it will be until normal people in the UK get the same service?

Navitime 3D railway buildings & transfer directions, on phone. (from here)

A side note: on maps in public spaces. They always have the North arrow. Its quite important. Even outside, you will see it on the floor.

However, the maps shown outside for navigation are not, in the main, orientated so that North is pointing up. Instead, the maps are orientated according to how you stand looking at the map. So if the map is on a sign at the edge of a road, as you face the map, the road going from left to right will also go from left to right on the map. The map below is a good example, but here, the map, written in English, for tourists, at a major tourism attraction, Ritsurin Park in Takamatsu, Shikoku, gives these instructions on how to read it to the reader. Look at this map while facing the mountain.

OK, back to Megacity mapping. The mapping in Japan for OSM is gaining velocity. There was a genuine opinion from several people that their country would be completed soon, and quickly, and personally, I would not be surprised. Not only are there chizu otaku and enthusiasts getting involved, the government is showing positive signs, and characteristic of the project, there’s something for everyone to do.

Below is an animation of progress to date in OSM in Japan. Click on the animation for bigger better quality animation. Gives a good overview, I think.

In summary, I hope to see more attention applied to how we can capture, edit and make good maps of a proper three dimensional super detailed city. Otherwise, our maps will be just street-level maps, and will be unsuitable for normal people living and navigating these complex, dense places. Japan’s megacities and mappers could be a driving force.

EDIT: Kamakura Mapping Party (map) - First proper mapping party for Japan, probably later this month (May) - mapping Kamakura, a lovely town, by the sea, about an hour by train from Tokyo, and one chocked full of history, temples and atmosphere, and where I spent an afternoon seeing a couple of sights and adding a few things to the map. A great choice to have a mapping party!

The second of my Japan blog posts: A couple of weeks ago, we had a mini mapping party at Tokyo. My hosts were Hiroshi Miura from Openstreetmap.jp and the Kodeo (Little Edo) Linux User Group, a great group of people, professionals and enthusiasts. We met at the IPA (the IT Promotion Agency - a kind of governmental centre for promoting excellence in IT), near Sugamo. Hiroshi Miura, who recently has started openstreetmap.jp invited me to give a talk and demonstration about OpenStreetMap (slides) and then afterwards we walked out to map a local famous garden. Unfortunately, I may have gone on a bit, as by the time we got there, Rikugi-en Garden was closing (4:30), so instead we journeyed out to the more complex streets around probably better for giving a more representative view of osm mapping, if less pretty!

Most of the folks had GPS, after Miura-san introduced the OSM project to them earlier in the year. Many different types of GPS were present, a few built into phones, bluetooth, loggers, and one person even had a PSP with GPS unit (he said that the quality was quite poor, plus the only application that it can be used with, only works in Japan). Part of the afternoon was meant to be an exploration of the various quality of GPS receivers.

Road signs are different in Japan, many roads are not named - instead, the block that the road goes next to are marked, blocks of houses become the address, rather than the street the house is on. More details can be found on the wiki for mapping in japan (in english), and http://www.openstreetmap.jp (in japanese). The ward boundaries are apparently available from the government under a similar to CC-by-A licence, so work could be done to help import this into the osm database.

This is “hatochan” Kentaro Hatori - the organiser of Kodeo LUG, pointing out local landmarks! In this case the very famous Anpanman, outside a childrens creche.

Here are the initial results from that day (click map for big):

We noted many things, such as a difficult five road junction, with various types of roads. Junctions, parking, amenities, restrictions and buildings were among the things mapped. We also encountered a special form of police box a “Koban” - different from a police station (we came across one of those as well). Japan’s cities, and Tokyo is a good example are very compressed and dense - something that was mentioned a few times by those mapping- which brings certain problems and opportunities, but I’ll talk about these in my next post.

After heading back to the IPA we extracted GPX tracks, and started to do some editing using potlatch and JOSM. Then it was off to the pub. I’m pretty sure we ended up at Akasaka Gorou Hazime, for beer, shochu, dried & fresh fish & other tasty morsels. Much laughs, and cultural understandings were exchanged about the world of otaku, and things geek! I found out about bash-on-rails (apparently it works really well), and some of the activities of the LUG, including selling “attractively covered” linux mags at the huge twice yearly Tokyo Comic Market. We ended up at a famous pig back-fat ramen shop, for a bowl of oishii-delicious noodles. I think we all enjoyed ourselves! Thanks to Hiroshi and the folks at Kodeo LUG!

OK, I’ve been in Japan for about 10 days now, so will relate some of the events in chronological order, over the next few posts. In short, I decided upon a short spell of travelling to Japan, and noticed at the time that openstreetmap.jp had just been formed, and the community was starting to come together, so sent a couple of emails out, asking if anyone would like to meet up, for a mini-mapping party or something. Was invited to Osaka City University to talk about OSM, and take part in a short mapping party to a local shrine, and invitied to Tokyo (where I am currently) to talk at a Linux User Group, and a mapping party around the area.

Professor Venkatesh Raghavan and grad student Diasuke Yoshida, invited me to Osaka, to give a talk. David Hastings of the UN ESCAP also spoke on sustainable tourism via the web. Before we talked the geo phd and masters students walked to the nearby Sumiyoshi-shrine, together with multiple GPS devices, paper pen and digital dicataphone. We walked along an ancient road to the shrine past ancient buidlings, amazing gardens, shrines and cemetaries.

The talk went well, with interesting discussion about integrating other VGI information, harnessing the power of people (as typified by wikimapia), about how to utilise osm for pedestrian navigation. There is a great deal of enthusiasm for openstreetmap, and there is a feeling that the country will be mapped quickly by a growing band of mappers! In Osaka, the students are involved in a number of interesting projects including automatic feature extraction from gpx, live streaming of gps nmea to server, using differential GPS, forecasting (futurology) of geospatial (GPS was sucessfully predicted by japanese in 70s). Fascinating stuff.

Some general notes about mapping in Japan, from a westerners point of view:

Railways and subways have been privatised, and are often run by different companies, however they use colour for identification of these.

Tall buildings in city centre, not good for those old GPS units, but elsewhere, in the cities, there houses are about 3 stories tall, and smaller in Kyoto, for example.

—

Special mention has to be given to Prof. Raghavan, Diasuke, Sensei Minami, Akiko, and Danielle for their overwhelming hospitality in Osaka and Kyoto. An open invitation is offered to the UK to them!

next post will detail Tokyo, Openstreetmap, LUG, and some more observations about mapping such a dense place as Japan. Sorry if i’ve forgotten stuff, I’ve a horrendous cold (gotten from walking up a mountain in the rain!). Will try to update with more info.

This is a great application from Martijn (his blog) - it’s a style editor for Mapnik - one of the renderers used to render Openstreetmap data.

It goes a long way to helping differentiate the map from the data, as I discussed in this post “a manifesto?“. OpenStreetMap’s power is the data. It also shows the flexibility of mapnik, and the Freedom in being able to have the map you want.

http://tile.openstreetmap.nl/~panman/styledit/

Have a go by selecting some of the predefined styles.

The Lucky Penny map, (I’ve talked about it here) has won an Honorable Mention award in the StoryTelling category from Platial. Cheers guys!

Crossing the Pennines into Manchester brought the train from sunshine into drizzle, a drizzle continued all day, typical of the grim North (and especially the city of Manchester). But forgetting the rain, the North is the opposite of grim, as yesterday there was a furnace of activity, discussions and networking at BarCamp that made the North a shiny positive place to work.

Taking the title from the KLF track “It’s Grim Up North” (worth watching to the end -The North Will Rise Again”) my talk was a rapid discussion in the hottest room at the tiredest part of the day. You can get the slides here at slideshare, or view it below. Basically the slot was about vague vernacular geographies (the way normal people talk about areas), and working towards new tools to help capture, analyse and use. Good feedback was had, and the project shall be developed upon anew.

Here’s a map we made showing where some of the participants thought Wilderness was in the UK.

Full marks to Paul, the sponsors and organisers. It went really smoothly. (I won a book). There was much talk about similar events, alternatives, formats etc. I think that they get better and better as time goes on. Sheffield is the next (woefully, hugely unpublicised) barcamp up north, back across to the drier side of the Pennines.

Come to Bradford, West Yorks, tomorrow for OpenStreetMap’s first ever Mapping Pub Crawl, courtesy of the West Yorkshire Linux User Group. It will be very casual, and informal, no GPS needed. From the email:

We will rendevous at the following locations and times:

6.00 p.m. ‘The Cock and Bottle’ BD3 9AA

7.00 p.m. ‘The Beehive’ BD1 3AA

8.00 p.m. ‘The Fighting Cock’ BD7 1JE

The idea is to plug a hole the map, and get fairly inebriated at the
same time.

It’s entirely informal, with no planning and no expectations.

See you there!

WYLUG seems to have been bitten by the Open mapping bug, recently, they had a very good presentation and talk about OSM, then they organised a micro mapping party last Sunday for Leeds. Eight enthusiastic folks turned up, myself included, and I helped map the famous Jimmy’s Hospital, and the area towards town, see it on the map (when it recovers from the ongoing slashdotting!), now Bradford, which is disgracefully empty in coverage, hence no links to the pubs. Wonder if any of my mapping ex-colleagues from the Council will come…

Gedit is my editor of choice at the moment, but, with all it’s great plugins, it was kinda lacking when working with Mapserver map files. So far vim, textpad and notepad++ have syntax support for map files, and now I’m happy to announce, Gedit does!

There’s a bit of tweaking to get it working.

1. First, we need to tell gnome to associate the .map file with the syntax, by giving it it’s own mime-type (you could skip this, but then you would need to manually select the highlighting mode for each file).

Download this file: http://geothings.net/thinkwhere/mapserver/mapserver.xml and copy it to /usr/share/mime/packages/ directory

Then, update Gnome’s mime database:

$ sudo update-mime-database /usr/share/mime

2. Next download the syntax lang file: http://geothings.net/thinkwhere/mapserver/map.lang and copy it to the /usr/share/gtksourceview-1.0/language-specs directory (or gtksourceview-2.0 if you are using Gutsy)

3. Restart gedit, open up a .map file and voila!

Thanks to the vim, notepad++ and texpad syntax files that I used to write this. Tested with Ubuntu 7.04 (Fiesty) and gedit 2.18.1 - let me know if it works, or doesn’t with Gutsy.

For Gutsy, gtksourceview2.0 .lang files have a different syntax - but it is meant to work with 1.0 version files. There’s also a conversion utility convert.py that could help.

EDITS: See comments for a way to get it working with Gutsy, thanks Michal!