A Tale of Two GIS(es)

A few weeks ago my wife and I had a couple of nights in an Airbnb in the Black Mountains hills, part of the Brecon Beacons National Park in Wales. Part of the reason for choosing that particular location was that there were a few walks directly from the door with no driving involved. ( It was on a working farm with rare breed sheep and deer, the white building on the bottom right of the photo )

The weather wasn’t really conducive for walking but I managed one outing up a local hill called Waun Fach and, as usual, recorded the route on my GPS. I wanted to create a 3D model of the route but using some sort of contour line annotation rather than the Google satellite image that I’ve used previously. As always the process was not as straightforward as I’d initially imagined but I did eventually end up with something interesting:

The process is described in more detail below but a few notes:

  1. The red line is the GPS track. I’ve tidied it up slightly because there were a few gaps and I’m only showing half the route because it was an out & back on the same path.
  2. The terrain elevation data comes from the freely accessible LiDAR data.
  3. There are no pictures from my heroic summit push because the lead elements of Storm Eunice moved in and the low cloud and the horizontal driving rain were not an encouragement to hang about taking photos ๐Ÿ™‚

If you’re not interested in my adventures in cartography then scroll to the bottom where there are a few pictures and some history notes!

Overlay Plan A

My initial thought was to get the contour line data from the OpenTopoMap site ( example right ). This is based on Open Street Map and uses the same web API for fetching the data. The SAGA GIS tool that I’ve used previously will fetch the Open Street Map data and only required a small tweak to fetch the Open Topo data instead. However ( you knew that was coming ๐Ÿ™‚ ) there were three problems:

Note that these problems were largely diagnosed using the using the tcpdump tool which is invaluable for this sort of debugging.

Firstly the SAGA GIS download uses http rather than https. This isn’t a problem with OpenStreetMap as the same data appears to be downloaded whichever protocol is used. With the OpenTopoMap data however any fetches using http return a 301 Moved Permanently response which, although correct, is not parsed correctly by SAGA GIS and the download fails.ย  ( See also this note ). This I got round by temporarily adding a rule to iptables to redirect the outgoing http fetches to https.

Secondly, although the OpenStreetMap data is downloaded quickly, the OpenTopoMap equivalent didn’t seem to work. I thought that there was some problem with the API but by watching what data was being fetched I realised that it was working, just extremely slowly. I suspected that there was some throttling going on and by experimenting with the wget tool and changing the User Agent strings it seems that downloads from a web browser have a quick response something like SAGA GIS had a much slower response. However the OpenTopoMap data did finally download, taking about 20 minutes rather than the usual sub one minute for OpenStreetMap.

Finally I’ve always thought that the standard OpenStreetMap overlay images were at slightly too low a resolution and I decided that I needed to increase the zoom level that SAGA GIS was using for the download. Naturally the documentation is non-existent but I eventually found that by changing the “Block Size” in the “Import TMS Image” dialog from 256 to 128 I could change the zoom level from 16 to 17. However my jubilation was short lived as the OpenStreetMap download now started to throttle as well and it also seemed to be downloading a lot more data than I expected and I eventually lost patience that it would ever complete ๐Ÿ˜ฆ

Note that I’m not 100% sure that my analysis is correct on these three points but I can’t immediately see any glaring holes. Anyway, for my sanity, it was now time to abandon this method and move on …

Overlay Plan B

Similar contour line and map data is available from the Ordnance Survey website under a very liberal licence with just an attribution needed. I downloaded the relevant files from the following data sets:

  • OS Open ZoomstackA comprehensive basemap of Great Britain showing coverage from national level right down to street detail.
  • OS Terrainยฎ 50Visualise simple landscapes in 3D and bring your geographic analysis to life.

Unfortunately when I imported these into SAGA GIS it insisted on treating the GeoTIFF formatted basemap files as digital elevation data rather than as an images. If I forced it to import as an image then it seemed to lose the geographic coordinates. There’s a similar problem report here but I didn’t manage to get the suggested solution to work.

As a last, desperate, final attempt to make this work I switched tools and opened my copy of QGIS. This is another open source GIS tool with a lot more users and online documentation than SAGA GIS. However it’s swings and roundabouts as SAGA GIS has a much better gap filling algorithm which I’ve found essential for dealing with the LiDAR files as they seem to have a fair amount of missing data. Anyway all the data imported without a hitch into QGIS and I was able to clip it to fit the LiDAR data by using a GeoTIFF image exported from SAGA GIS. It literally took 20 minutes, 15 of which was taken in figuring out how to import and rearrange the Ordnance Survey data in the correct order. ๐Ÿ˜ฆ

After that it was just a case of exporting an overlay image of the correct resolution and creating the model. I had to crop it quite extensively to fit in the 50 Mbyte upload limit of my Sketchfab plan but it eventually worked OK. The resulting model is not bad but I’d like some more detail of the terrain. I think that this should be possible with a different OS data set but which will probably require an OS login ( which I have ) but they don’t make it easy to find the various products so that will have to wait for another day.

Welsh Marches

The eastern end of the Brecon Beacons is part of what is known as the Welsh Marches. The boundary between Wales and England has a long and complex history and the Marcher Lordships concept started in Norman times. ( I see it essentially as an early outsourcing arrangement where the King of England employed the Marcher Lords to keep the Welsh out ๐Ÿ™‚ ).

Naturally the area is chock full of castles and fortified manor houses, one of the finest being Tretower Court and Castle.

It was originally a 12th Century Norman castle which then morphed into a medieval fortified manor house in the 14th Century. The interior of the house has been restored to what is would have looked like in the mid 15th Century complete with medieval paint if you know where to look!

If castles are not your thing then we can also recommend Hay-on-Wye which styles itself as “the World’s largest Secondhand and antiquarian book centre”. I have no proof of this claim but I can confirm that it’s possible to spend an awfully long time browsing all the different bookshops on offer and to make a surprisingly large dent in your wallet at the same time. ๐Ÿ™‚

 

Movo MTP-20 Panning Timelapse Head Review

A panning or moving shot in a film can add so much more interest over just a static scene. This is especially true in timelapse movies but getting smooth movement over an extended period of time can be tricky. Moving by hand is out of the question so some sort of motorised set up is usually required. After doing a few timelapses recently I decided that I really wanted to add some motion so it was time to lever open the wallet, head off to the internet and do some shopping.

The prices for a motorised pan head range from really cheap home made affairs using a kitchen timer all the way up to “How much money have you got?” After some on-line research I decided on the Movo MTP-20 ( right ) which was a reasonable ยฃ70.

In the kit you get the unit itself with a ยผ” UNC thread for the camera, a USB power cable, a mobile phone mount and a GoPro mount. It weighs about 400g and can take cameras up to 2kg. Power is from either 4 x AA batteries or from an external 5V supply via the USB cable.

Settings are basic – you select the number of degrees to rotate through, the time interval for the rotation and the direction of rotation. After that press “start” and it rotates. There’s also a continuous rotation mode at seven different speeds.

Example

Because of the overcast weather I’ve only had one outing with the unit so far but I managed to come up with one video that I was happy with:

This is at Burry Port harbour and I was initially only going there to get some cloud movement in the sky. However by chance the incoming tide was just at the right point and so I got some very interesting effects in the water as well. ( It helps to live on an estuary with the 2nd highest tidal range in the world ๐Ÿ™‚ ) I used an 8 stop ND filter to get the shutter speed down to ยผs and the whole movie consists of 500 shots at 2s intervals. It was late in the afternoon and quite overcast so the light is a bit flat.

Comments on Operation

There’s not a lot to say about the operation as there are very few controls and they’re all perfectly logical. The only problem I found is that the LCD field of view is not very wide so with the unit set up low to the ground as on the right you have to get down near to the floor to see the settings. The obvious way round this is to tilt the tripod head forward so that the LCD can be seen, set the values then set the head back to the required position. Associated with this problem is the fact that the only feedback when you press the “start” button is that the time display starts to count down which is difficult to see. An audible “beep” or flashing the power LED while the unit was rotating would be useful.

There are markings every 10ยฐ on the top which helps in determining the rotation angle. It would have been even more useful if these had been numbered as it’s tricky to count the number of marks while also checking the view in the camera display. I suspect that a white Sharpie pen will fix this problem though ๐Ÿ™‚

One thing that initially caught me out is that, as the unit is mounted on top of the tripod head, then it needs to be perfectly level in all directions. I missed this at first and while the movie started level the horizon slowly tilted as the unit rotated. Fortunately the camera has a built in level indicator so checking at the start and end points of the rotation when doing the set up is quite easy.

Verdict

After one outing and some experimenting at home the unit works fine. It has a simple job to do and it does it very well! There are a couple of usability issues that I’ve mentioned above but in reality these are very small and fairly easy to overcome. At this price point I’m not going to complain too much.

From my internet research the best way of doing this sort of movement is to sync the motion and the shutter release so that the camera is stationary when the picture is taken. However this means that your camera and the rotating unit need to be compatible and, anyway, my compact camera doesn’t have a cable release, it’s all done via Wi-Fi. The second best way of doing it is to use a DC motor rather than a stepper motor so that the rotation is smooth but this of course needs some sort of position encoder which will add to the price. Like all cheap units the Movo uses a stepper motor but it looks smooth enough to me. Because of the nature of timelapse movies I find it hard to differentiate jerky movement with what’s happening in the scene but I may experiment with a “normal” movie as well to see if there are any obvious problems.

The unit seems to be well made with the turntable and body made out of metal and the buttons have a reasonable quality feel to them. So now it’s a question of finding some interesting subjects and getting out there and making movies ๐Ÿ™‚