I've been thinking about what could be done with mediated-reality glasses, i.e. ones that can edit your view of the world before you see it. As it happens, there are researchers developing what sound like some very suitable glasses very near me: in the Nuffield Department of Clinical Neurosciences, where Dr Stephen Hicks and his team have set up the Oxford Smart Specs Research Group.
Smart Specs use clever image processing to help people with very bad sight see better, as shown in the group of four images near the top of the Smart Specs page. The first image shows a lecture room in natural colour, with a view of some chairs and two men in the foreground, and a cupboard and door in the background. The following three images have been processed into monochrome, and show only the chairs and two men. Details have been thrown away, and contrast enhanced, making chairs and men much easier to see.
From an artistic point of view, the third image is the most interesting. It shows a very clear edge-detected image of one of the men, simplified so that only his hair, glasses, eyes, nostrils, mouth, chin-tip, T-shirt and trousers, and arms and hands (half in pockets) are visible. If you had a pair of Smart Specs and you wanted to cheat at urban sketching, you could do so very effectively by using the same algorithm to capture and render your subject in line.
But let's assume that you want to do the drawing yourself, rather than letting the computer do it for you. (Though perhaps, with kit such as this, as well as programs like the one Michael Haller, Florian Landerl, and Mark Billinghurst describe in "A Loose and Sketchy Approach in a Mediated Reality Environment", sketching will one day be as dead as John Henry's steel-driving.) How could Smart Specs help you learn to draw better? Here are some possibilities.
Highlight regions of negative space. This is the space between objects. As I've mentioned in this blog already, paying attention to this space, rather than to the objects themselves, fools the brain into drawing more accurately. See, for example, Brad Kasten's "Once you master negative space drawing it will forever change the way you see the world" page. But you need to learn to "see" negative space, and a tool to point out instances in real scenes would be very helpful.
Superimpose basic shapes. Here, you break objects down into simple two-dimensional shapes such as triangles and rectangles, and use these to create a framework for your drawing. There are some examples here at Bob and Phil's "Learn to Draw Whatever You Want" page. Once again, a tool that demonstrates instances in real scenes would be useful.
The image processing would be harder than for negative space, because the former is an objective notion, whereas decomposition into basic shapes is subjective. You can argue about how much the body of a bird, say, must deviate from a triangle before it stops being useful to see it as one. But by inducing from example decompositions drawn by artists, it should be possible to define a best-match criterion.
Both negative space and basic shapes are techniques for seeing more accurately. So are the suggestions below, but in a rather different way. I don't think I'd call them "techniques" now: they're more like tools that could be applied either to the scene you're currently drawing, or to lots and lots of scenes that you can learn relationships from.
Superimpose a rectangular grid, to help you judge angles and lengths. This can also be useful in composing a drawing, as explained in Russell Stutler's "Page 11. How to Sketch" page.
Superimpose a horizontal rectangular grid, receding into the background, onto surfaces such as pavements and floors. This would provide a baseline for people's feet, and also show how distances parallel to the picture plane relate to distances perpendicular to it.
Superimpse ellipses onto clockfaces, wheels, the tops of cups, to show how to draw circles in perspective.
Superimpose plausible skull, skeleton, and muscles onto people and animals, to help understand their anatomy.
This would require much much much more processing than the suggestions above, and I don't know whether it's feasible yet. But there certainly is work going on, as I found from Michael J. Black's presentation "Inferring 3D People from 2D Images".
Label different types of crease in clothes. Creases are important in drawing clothes accurately. But also, even in an abbreviated way in cartoons, they're useful for giving information about people's poses. For example, is part of the sleeve round an arm stretched or not, and what direction do the creases show the arm to be pointing in. There are several different kinds of crease — see 'Types of Folds An Illustrated Tutorial from "Drawing People: How to Portray the Clothed Figure"' by Barbara Bradley — and it's important to use the right type for the situation. So it would be useful to have a tool that classifies creases in real-life scenes.
Now here's a different type of suggestion again. Not for seeing more accurately, but for "seeing as".
Render reality in a particular style, in order to improve the translation from scene to style. Most lines in a line drawing don't exist in the scene, but have been introduced by the artist according to some set of conventions. In an analogue to sight-reading music, can you learn to look at a scene and "see" it in a particular artistic style? Russell Stutler suggests in "Page 11. How to Sketch" (under "Visualize the sketch on paper") that you can, and I've suggested a possible method here. You could do this on an ordinary computer, but running the rendering program on Smart Specs would enable users to immerse themselves in the results, perhaps making them much more effective.
And finally, here's one that would help with practising particular objects. When I'm in the street and I've just drawn a hand in a particular position, say, I often wish I could try drawing a slight variant. Not an hour or two later, when I can get back to reference books or computer, but immediately in order to help consolidate the original. So it would be great to have a program that can:
See what I've just drawn, search Google's image bank for photos of variants, and display them in front of my eyes for me to practise on.
No comments:
Post a Comment