3D Tutorial

Second Picture is devoted to original tutorials about 3D graphics, Photoshop, Photography and Web Design.

3D Max Tutorials

Cell Shading

Toon shading in 3DS MAX

Picture 1. Cell shading in 3DS MAX.

12.07.2008 Category: 3D (Rendering)
In 3D graphics cell shading (also called cartoon shading or toon shading) means a material / rendering method that produces a result that looks like a hand drawn picture. The purpose of cell shading is to create a rendering that looks like cartoon or comic book style.

In this cell shading tutorial I cover a method of doing cell shading in 3DS MAX with the scanline renderer. Of course cell shading can be done by using Mental Ray's Ink'n Paint material but in this tutorial I concentrate on a method that is very fast and works with both scanline renderer and Mental Ray.

Default Rendering in 3DS MAX

Default rendering in 3D Studio MAX

Picture 2. A rendering in 3DS MAX with the default settings of the scanline renderer. The picture is illuminated by one Omni light.

In picture 2 you see a standard rendering in 3D Studio MAX. All material settings have default values except for the diffuse value which has been adjusted to get some color. The model is illuminated with one Omni light. So if you are trying cell shading according to this tutorial, please do the following preparations:

Remove shading

Self illuminated and rendered 3d model

Picture 3. Self-Illumination is changed to 100. As a result there is a rendering with no shading. In other words there are no darkness variations in any single color.

The first thing to do is to get rid of the shading. At the moment the model is clearly shaded. There is a lot of color variation that depicts the levels of darkness. Shading can be removed from material by changing Self-Illumination to 100 (Blinn Basic Parameters > Self Illumination: 100). The result is shown in Picture 3. (If you are familiar with 3DS MAX you might wonder why we even created the Omni light. At the moment the light has no effect at all but in the end it will have.)

Add Composite Map

Material settings in 3D MAX

Picture 4. Composite map is the basis for cell shaded material.

We will be using two separate maps to achieve cartoon rendering:

We will use Composite map to combine these two maps into one material. So first add Composite as Diffuse Color Map according to picture 4.

Add Cell Shading

Composite map settings

Picture 5. Falloff map is used to achieve toon shading in 3DS MAX.

Falloff map parameters: colors for cell shading

Picture 6. The upper color is the color on the shadow side and the lower color is the color on the side of the light source.

Mix curve in Falloff map

Picture 7. Cell shading is easily achieved by adjusting the Mix curve.

Cell shaded graphics in 3DS MAX

Picture 8. Cartoon rendering in 3DS MAX.

The actual cell shading is achieved by using Falloff map. Click on Composite map and add Falloff as Map 1 according to picture 5. Click on Falloff map and make the following adjustments to it:

Cell Shading with Borders

Add Mask

Composite Map sub maps

Picture 9. Add Mask to Map 2 in the Composite map.

Mask parameters

Picture 10. Noise map is used just to produce a black color.

Noise map parameters

Picture 11. Noise map's output is just black color.

Sub maps of Mask

Picture 12. Black borders for the cartoon shading are achieved by combining black color (Noise) with a mask (Falloff).

Mix curve of Falloff map

Picture 13. Staircase Mix curve controls the thickness of the black edges.

Let's add black edges to our cell shader. Go back to the Composite Map and add Mask as Map 2 according to picture 9. (In rendering the Map 2 is displayed on top of Map 1. The purpose of Map 2 is only to produce back edges. Mask is needed because we want to show Map 2 only partly (edges)).

Add Noise Map

Next click on Mask. There are two slots: One for Map and one for Mask. First we need to place black color to the Map slot. Let's do that with a Noise map. Choose Noise as Map according to picture 10.

Click on Noise and change the white color to black according to picture 11. This way the output of this Noise map is just black color. (We could have achieved the same output also with several other maps)

Add Falloff Map

Go back to Mask and add Falloff as Mask according to picture 12. We'll use Falloff map to mask unwanted parts away.

Click on Falloff and adjust the Mix Curve according to picture 13. Add two new control points and place them according to the picture. (The placement of the stair controls the thickness of the black edges.)

Cell Shaded Rendering

Cell shading

Picture 14. Cell shading with Super Sampling.

Render to test your cartoon shader. The rendering style should look similar to picture 14. If you render a large picture you will see many jagged edges. To fix this just turn Super Sampling on. If you have several materials you might want do that globally in Renderer's settings. Picture 14 is rendered with Super Sampling. (The effect of Super Sampling is hardly visible in such a small rendering but in large renderings the effect is clearly visible).

Cell Shading With Three Colors

Usually two color shades is suitable for cell shading but sometimes you might want more. If you need more color shades just add one or more steps to the Falloff Map's Mix Curve. Just make sure you adjust the right Falloff map. It's the one with color.