Question

Consider a fully connected feedforward network with one hidden layer. The network takes the input of vector with dimensions [500 X 1] and consists of 100 hidden neurons. What are the total number of connections between the input and the hidden layer?

(a) 5000
(b) 5¹⁰⁰
(c) 50000
(d) 100

Answer 1

In a fully connected feedforward network with one hidden layer, the total number of connections between the input and the hidden layer can be calculated by multiplying the number of neurons in the input layer by the number of neurons in the hidden layer. In this case, the input layer has 500 neurons and the hidden layer has 100 neurons, resulting in 500 * 100 = 50000 connections.

Step-by-step explanation:

In a fully connected feedforward network with one hidden layer, every neuron in the input layer is connected to every neuron in the hidden layer. The number of connections between the input and the hidden layer can be calculated by multiplying the number of neurons in the input layer by the number of neurons in the hidden layer.

In this case, the input layer has 500 neurons and the hidden layer has 100 neurons. Therefore, the total number of connections between the input and the hidden layer is 500 * 100 = 50000.

So the correct answer is (c) 50000.