What Is a Convolutional Neural Network? | 3 things you need to know (2024)

How CNNs Work

A convolutional neural network can have tens or hundreds of layers that each learn to detect different features of an image. Filters are applied to each training image at different resolutions, and the output of each convolved image is used as the input to the next layer. The filters can start as very simple features, such as brightness and edges, and increase in complexity to features that uniquely define the object.

Feature Learning, Layers, and Classification

A CNN is composed of an input layer, an output layer, and many hidden layers in between.

These layers perform operations that alter the data with the intent of learning features specific to the data. Three of the most common layers are convolution, activation or ReLU, and pooling.

• Convolution puts the input images through a set of convolutional filters, each of which activates certain features from the images.
• Rectified linear unit (ReLU) allows for faster and more effective training by mapping negative values to zero and maintaining positive values. This is sometimes referred to as activation, because only the activated features are carried forward into the next layer.
• Pooling simplifies the output by performing nonlinear downsampling, reducing the number of parameters that the network needs to learn.

These operations are repeated over tens or hundreds of layers, with each layer learning to identify different features.

Example of a network with many convolutional layers. Filters are applied to each training image at different resolutions, and the output of each convolved image is used as the input to the next layer.

Shared Weights and Biases

Unlike a traditional neural network, a CNN has shared weights and bias values, which are the same for all hidden neurons in a given layer.

This means that all hidden neurons are detecting the same feature, such as an edge or a blob, in different regions of the image. This makes the network tolerant to translation of objects in an image. For example, a network trained to recognize cars will be able to do so wherever the car is in the image.

Classification Layers

After learning features in many layers, the architecture of a CNN shifts to classification.

The next-to-last layer is a fully connected layer that outputs a vector of K dimensions (where K is the number of classes able to be predicted) and contains the probabilities for each class of an image being classified.

The final layer of the CNN architecture uses a classification layer to provide the final classification output.

Why CNNs Matter

CNNs provide an optimal architecture for uncovering and learning key features in image and time-series data. CNNs are a key technology in applications such as:

When Should You Use CNNs?

Consider using CNNs when you have a large amount of complex data (such as image data). You can also use CNNs with signal or time-series data when preprocessed to work with the network structure.

See these examples for working with signals and CNNs:

Consider Using Pretrained Models

When working with CNNs, engineers and scientists prefer to initially start with a pretrained model and that can be used to learn and identify features from a new data set.

CNNs with MATLAB

Using MATLAB® with Deep Learning Toolbox™ enables you to design, train, and deploy CNNs.

Related Topics

Getting Started with MATLAB