Ask Your Question
0

DNN, loading of models and order of channels

asked 2018-05-07 10:47:45 -0600

MrEsp gravatar image

Hello,

The following questions are relevant for version 3.3.1:

1) The default ordering for Tensorflow is N H W C; blobFromImage, however, returns N C H W order, which is fine , but what types of ordering does readNetFromTensorflow support to comply with that ? Should we from Tensorflow/Keras side change ordering to NCHW before exporting the model to OpenCV?

2) How does readNetFromTensorflow process fully connected and convolutional layers not to mess up with ordering ?

3) Are there any differences in OpenCV 3.4+ ?

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted
3

answered 2018-05-08 00:10:26 -0600

dkurt gravatar image

updated 2018-05-08 00:12:15 -0600

@MrEsp, the main goal is that default usage of TensorFlow should maches default usage of OpenCV. You're right, TensorFlow uses NHWC data layout by default but OpenCV uses NCHW. Use blobFromImage to create NCHW blob from an image and pass it to imported network. You may find set of tests generated from TensorFlow. In example, image->convolution->flatten (reshape to 2-dimensional vector persisting batch size dimension)->fully-connected network:

inp = tf.placeholder(tf.float32, [1, 2, 3, 4], 'input')
conv = tf.layers.conv2d(inp, filters=5, kernel_size=[1, 1],
                        activation=tf.nn.relu,
                        bias_initializer=tf.random_normal_initializer())
flattened = tf.reshape(conv, [1, -1], 'reshaped')
biases = tf.Variable(tf.random_normal([10]), name='matmul_biases')
weights = tf.Variable(tf.random_normal([2*3*5, 10]), name='matmul_weights')
mm = tf.matmul(flattened, weights) + biases
save(inp, mm, 'nhwc_reshape_matmul')

2) How does readNetFromTensorflow process fully connected and convolutional layers not to mess up with ordering ?

For common image processing pipelines with convolution layers we can use TenorFlow nodes' attribute which indicates data layout. Depends on TensorFlow version they are called NCHW and NHWC or channels_first and channels_last correspondingly. For this particular example above, OpenCV inserts permutation layer before reshape so both flatten's and matmul's outputs from OpenCV and TensorFlow libraries are similar. Convolutions' outputs are the same too but in different layouts.

3) Are there any differences in OpenCV 3.4+ ?

OpenCV grows fast and the newer version it is the more deep learning architectures it can cover. However all the users applications which already worked with old versions should work in the same way with next releases of OpenCV.

edit flag offensive delete link more

Comments

@dkurt, Based on your comments above, tensorflow models should work out-of-the-box with OpenCV DNN. Am I right? I'm facing problems with my tensorflow model and I've shared details here - https://answers.opencv.org/question/2...

It would be great if you could share your thoughts there.

santo4_opencv gravatar imagesanto4_opencv ( 2020-04-29 07:29:41 -0600 )edit

Question Tools

1 follower

Stats

Asked: 2018-05-07 10:47:45 -0600

Seen: 2,406 times

Last updated: May 08 '18