Wednesday 8 January 2014

Browser for your OS X Time Machine Backups (Updated)

A few years back I was very excited about a browser for OS X's Time Machine called Time Tracker. It probably still works, but remains in its very early "unpolished" state (in the author's own words). So here's another one that I've been using for a while now, one I personally think is well polished and much better.

BackupLoupe by soma-zone — Advanced Browsing for Time Machine

If you're not paying attention to Time Machine as it backs up, you won't see the size differences—and even if you are, there's no easy way to see individual file differences. In some ways that's the beauty of Time Machine—it's totally set and forget, completely out of the way. But sometimes you want to take a closer look... and that's where BackupLoupe comes in.

BackupLoupe is useful for diagnosing why Time Machine is so slow, or why the last backup was 32 GB even though you don't think you changed anything, or even checking that there was actually a 10 GB backup after you imported your holiday photos into iPhoto...

It's well worth the $5 USD (which I paid after using it for a while—there's no copy protection, but its cheap and very useful).

High Level Differences

The main feature in my view is being able to see the differences between any two successive backups. That is, on top of the normal browsing features of Apple's own Time Machine interface (browsing for a file, viewing/restoring it).

Basic BackupLoupe interface—colours indicate where the big chunks of backup data have gone, and you can easily dig down into backups to see exactly what changed.


My first use of BackupLoupe was looking for cache data, logs and other essentially temporary/transient files that really didn't need to be backed up on my previous, slower Mac. Some applications do indeed prevent their cache files being backed up, but there's some caches (like my email application's local cache of my already-remotely-backed-up-emails) that just doesn't need to be backed up every hour, slowing the rest of the backup down, and ultimately using up space that would otherwise allow longer-term backups of my important data.

File Changes

BackupLoupe also works with MobileBackups. These are the backups that Time Machine does when it can't find any of your Time Machine disks (e.g. when you're away from the office/desk), so that you still have hourly backups, even though they're not on a redundant/separate disk. They proved quite useful recently when I was playing a game and several save files were lost due to a bug in the game's UI.

Thanks to Time Machine, the files were backed up exactly as they had been about 45 minutes earlier. Thanks to BackupLoupe it was very easy to see which ones had changed (updated, and thus OK), and which had been lost (deleted, and needing to be restored).

MobileBackups saved my saved games, BackupLoupe showed me which files had changed and how, even though I would otherwise have no idea which file is which.
And if you want to see how and when the file has changed over time, you can do that too. Just open up the 'History' panel to see a list of backed up versions of the file. Double-clicking takes you to that revision in the backup history, or right-click to bring up the 'Show Differences' option, which opens the two versions of the file in Apple's excellent FileMerge application, showing you the actual changes to the file, side-by-side.

See detailed file changes with the 'History' side panel. Bringing up the context menu allows you to see differences between snapshots in FileMerge.

All up a very useful application, if you want to delve a little deeper into your Time Machine backups, see exactly what is being backed up, see how big each incremental backup is, what files are changing and how, and look for possible exclusions to speed things up and save space.

Monday 6 January 2014

Sensor Aspect Ratios — What's Best?

I was inspired by a question on the Photography StackExchange site to think about digital camera image sensors, specifically the aspect ratios commonly seen.

Without getting into a long history of aspect ratios, I'll just say that far and away the most common aspect ratios for digital cameras are 3:2 and 4:3. There's various aspect ratios around these commonly used (TV 4:3, HDTV 16:9, Movies 1.85:1 or 2.4:1) as well as many variations in things like picture frames. Another common aspect-ratio is 1:1, though often for smaller things like profile pictures, and instagram photos.

Suffice to say, whatever camera you have, there's a good chance you'll end up cropping images for different purposes (even if you don't do it explicitly, such as the automatic cropping when you print for a specific frame). And you'll probably find you use one or two aspects ratios more often than others (e.g. HD videographers will probably mostly want 16:9, many professional photographers like 3:2, social media junkies perhaps prefer square).

So what is the best aspect ratio for a camera? Why don't they make native 16:9 cameras, given the prevalence of 16:9 video, or square sensors in phones mostly used for social media?

Ok, so there are some that don't conform to the 3:2 or 4:3 standards. The Lytro actually has a square sensor, Canon are rumoured to be developing a square sensor, and OmniVision make some low resolution Native HD Sensors (16:9, 1-2MP). There's probably more, but its pretty uncommon, even in dedicated video cameras. I had assumed GoPro Hero 3+ Black cameras had 16:9 sensors because of their 4k video (4096x2160), but it looks like they're a ~4000x3000 sensor.

So are square and wide sensors an untapped market? Or are they just gimmicks we don't need?

Obviously if you are always shooting/recording for a specific aspect ratio, then the ideal sensor is also that aspect ratio—that way you're not wasting part of the image circle by cropping. So let's see what's actually being wasted when we crop...

The ideal case is going to be a circular image sensor. Well, sort of. The viewfinder would be weird. The RAW files would be weird. Framing would be awkward. You'd probably just set it to 4:3 or 3:2 anyway unless it was super easy to adjust on-the-fly. It's another thing to think about, etc... But mathematically, it does give you the most pixels on your image (assuming a given maximum pixel pitch) and give you the most coverage of the image circle (what with it being circular and all).

So this is a few standard crops from a "circular sensor":
Some standard aspect ratios, at maximum size within the image circle.
And here I've taken each of those standard crops, as if they were the image sensor, and applied various crops to show how much smaller they get.
Crops from a 1:1 sensor
Crops from a 4:3 sensor
Crops from a 3:2 sensor
Crops from a 16:9 sensor

The point to notice is that the non-native crops start to get quite small, specially from the 1:1 or 16:9 sensors. Look especially at the 1:1 crop from the 16:9 sensor, and vice versa—both are considerably smaller than they could otherwise be. You can see the 4:3 and 3:2 sensors provide a bit more of a 'middle-ground', and are thus more flexible to be used with different aspect ratios.

Below is a table showing the coverage of each crop of the image circle for comparison. The columns show what 'limits' the crop (i.e. which sensor is used) and the rows show what shape the crop is. Higher values mean a larger area of the image circle is used, which is generally a good thing (more pixels, assuming a specific pixel pitch).
Coverage of the image circle for the various crops from the various sensors described above.
The table shows much the same information, as the images, though perhaps a little easier to compare directly. As you'd expect, the maximum coverage is achieved when only limited by the image circle (IC). In general, the 4:3 and 3:2 native aspect ratios provide the most 'general purpose' sensor, in that they provide reasonable coverage for both 1:1 and 16:9.

Note, however, there's still a significant chunk of the image circle 'thrown away' by using rectangular (including square) sensors. The CMOS Sensor Squared rumour about Canon's square sensors talks about the square sensor as fitting entirely within the image circle. I think the more likely implementation would be this:
Extra-large square sensor, covering square, and both portrait & landscape oriented 3:2-sized regions.
Instead of using the 'inner' square, which immediately loses the edges of a 3:2 image in either orientation, a slightly larger sensor (or possibly even the kind-of-plus-shaped-sensor) means you keep full-sized 3:2 crops in both orientations, as well as an otherwise-impossibly-large square crop.

Bigger sensors get significantly more expensive though, and require bigger mirrors, so this may well be out of the question. I'm even wondering if the rumoured square sensor is possible with the EF-mount lens-flange-distance.

Anyway, I hope the table and graphs show why we're still using 4:3 and 3:2 sensors.

Sure it'd be nice to have native 16:9 or 1:1 for those who only use one aspect ratio, but a 16:9 crop from a 3:2 sensor is only 8% smaller, while you lose 28% of the area for any of the squarer crops from a 16:9 frame (compared to cropping from 3:2). And, while you lose a lot cropping to 1:1 from any of these sensors, cropping to the common rectangular sizes from 1:1 cuts the image down by 28% compared to cropping from a 4:3 frame. For generic use: small gains, big losses.

Besides, you likely get a much better quality mass-produced-3:2-sensor than you would a (slightly wider, but lower production) 16:9-sensor anyway.