**(Oct 2017) Applications of Deep Learning Neural Network**

**IDS 2017 Workshop on Applications of Deep Learning Neural Networks**

**Department of Computer Science, Chu Hai College of Higher Education**

**Date: 20 Oct 2017**

**Venue : Lecture Hall 1**

**Prof. Franco SCARSELLI, Professor, University of Siena**

__Application of Graph Neural Networks__

Graph Neural Networks were introduced in 2010 as a generalization of previously recursive neural network architectures which were designed to model data with an underlying data structure, e.g., trees. The tree structures while being very useful in modelling natural languages, require significant amount of data to train. The GNN on the other hand do not have such a strong requirement on the data structure, and therefore require less number of data points. GNN has since been applied to many different situations.In this talk, the applications of GNN to various practical situations will be considered. Moreover, it will be shown how the GNN can be applied may be in combination with other neural network architectures, e.g., self-organizing map, multilayer perceptron, to give some of the best results on some of the benchmark datasets.

**Dr. HAGENBUCHNER,M. Associate Professor, University of Wollongong**

__Application of Recursive and Recurrent Neural Networks__

Fully Recursive Perceptron Network (FRPN) is introduced as a novel architecture which could be used an alternative to deep neural networks. This is a simple network, but more compact than the deep neural networks in that it require less number of parameters to achieve similar results than an equivalent deep neural network. In practical implementations, this would be quite significant, as there would not need to be extensive implementation of the number of layers, and the varying number of hidden neurons in each hidden layer. This talk will concentrate on the possible applications of FRPN to various practical situations..

**Prof. TSoi Ah Chung, Adjunct Professor, University of Wollongong**

__Applicability of deep learning techniques__

In this talk, a common and popular preprocessing model, called convolutional neural networks will be re-examined in light of its highly restrictive fixed architectures. In other words, the way in which CNN works is to consider a window of convolution, and use this window to process all the pixels in an image in a fixed fashion. We would like to re-formulate this problem as a multilayer perceptron problem, involving a single hidden layer. We will show this re-formulation would allow different insights into the reason why CNN works, and why there may be a need of deep CNNs as proposed recently in the literature. This is then evaluated by working through common and popular benchmark datasets. This would provide a practical method for application of the deep CNN concept to practical situations.

**Mr. Pascal Zhang, Research Assistant, Department of Computer Science, Chu Hai College of Higher Education**

__Application of deep learning to pose estimation problem__

This talk will report on the application of tracking idea to pose estimation in computer vision. The problem can be stated as follows: given a number of videos of animate objects, e.g., humans, is it possible to determine the pose, if the person is standing, sitting, lying, reclining, etc. from such videos. Mr Zhang will show how the concept of object tracking may be used as a way to track the movements of various parts of the person, and from there, to infer on the pose of the person.

**Dr. Markus Hagenbuchner and Prof. Ah Chung Tsoi**

__Transfer learning applied to practical problems__

In this talk, we will consider the issue of inadequate amount of training data in some domains, while there may be more abundant data in another domain. This situation occurs often in practical situations. It will be shown how the trained model from a domain with large number of training data can be adapted to work on the domain with inadequate number of training data. This is applied to a number of datasets to illustrate its capabilities.

**ORGANIZER**

*THIS SEMINAR IS FULLY SUPPORTED BY A GRANT FROM THE RESEARCH GRANTS COUNCIL OF THE HONG KONG SPECIAL ADMINISTRATIVE REGION, CHINA (PROJECT NO. UGC/IDS13/14). (PI: PROF CHANG CHUNG-NAN, CHU HAI COLLEGE OF HIGHER*