Difference between revisions of "Object Recognition with Deep Boltzmann Machines"
CarloDEramo (Talk | contribs) |
CarloDEramo (Talk | contribs) (→Deep learning and Boltzmann machines) |
||
| Line 2: | Line 2: | ||
This project aims to exploit the ability of Deep Belief Network (DBN) to classify (and generate) multiclass objects. Initially, they will be used to classify road signs with the purpose to help the navigation of an hypotetical autonomous car. Since the initial results on the classification tasks of road signs using DBN are very good, we are pretty confident about the quality of the project. After that, we will consider the possibility to extend the task to other domains.{{Project | title=Boltzmann machines | short_descr= Boltzmann machines for classification tasks | coordinator=MatteoMatteucci | tutor=MatteoMatteucci;FrancescoVisin | students=CarloDEramo | resarea=Robotics | restopic=Machine Learning | start=2014/03/1 | level=Ms | status=Active}} | This project aims to exploit the ability of Deep Belief Network (DBN) to classify (and generate) multiclass objects. Initially, they will be used to classify road signs with the purpose to help the navigation of an hypotetical autonomous car. Since the initial results on the classification tasks of road signs using DBN are very good, we are pretty confident about the quality of the project. After that, we will consider the possibility to extend the task to other domains.{{Project | title=Boltzmann machines | short_descr= Boltzmann machines for classification tasks | coordinator=MatteoMatteucci | tutor=MatteoMatteucci;FrancescoVisin | students=CarloDEramo | resarea=Robotics | restopic=Machine Learning | start=2014/03/1 | level=Ms | status=Active}} | ||
| − | == Deep learning and | + | == Deep learning and Boltzmann machines == |
'''Deep learning''' is a set of algorithms in machine learning that attempt to model high-level abstractions in data by using architectures composed of multiple non-linear transformations. | '''Deep learning''' is a set of algorithms in machine learning that attempt to model high-level abstractions in data by using architectures composed of multiple non-linear transformations. | ||
We will work on Boltzmann machines, an energy-based model which has been proven to perform very well in image and speech recognition tasks. A Boltzmann machines is composed of visible units representing the inputs of the network provided by the dataset and hidden units representing the feature detectors of the net. In a general fully connected Boltzmann machine each pair of unit is connected with a symmetric connection with a certain weights. We will focus on DBMs that are a particular type of Boltzmann machines built by stacking several layers of RBM on top of each other in a proper way. A RBM is known as restricted Boltzmann machines, a Boltzmann machines with no intra-layer connections. We'll study also deep belief network (DBN), a hybrid model between a neural network with discriminative and generative connections and a DBM, which has only symmetric connections. | We will work on Boltzmann machines, an energy-based model which has been proven to perform very well in image and speech recognition tasks. A Boltzmann machines is composed of visible units representing the inputs of the network provided by the dataset and hidden units representing the feature detectors of the net. In a general fully connected Boltzmann machine each pair of unit is connected with a symmetric connection with a certain weights. We will focus on DBMs that are a particular type of Boltzmann machines built by stacking several layers of RBM on top of each other in a proper way. A RBM is known as restricted Boltzmann machines, a Boltzmann machines with no intra-layer connections. We'll study also deep belief network (DBN), a hybrid model between a neural network with discriminative and generative connections and a DBM, which has only symmetric connections. | ||
We will use ''Pylearn2'' framework which offers training procedures of deep neural networks. During the project we will go deep in the analysis of this kind of networks studying their potentiality and flexibility; we'll try different configuration of networks in order to obtain the good performances we're looking for. | We will use ''Pylearn2'' framework which offers training procedures of deep neural networks. During the project we will go deep in the analysis of this kind of networks studying their potentiality and flexibility; we'll try different configuration of networks in order to obtain the good performances we're looking for. | ||
Revision as of 23:37, 2 July 2014
Intro
This project aims to exploit the ability of Deep Belief Network (DBN) to classify (and generate) multiclass objects. Initially, they will be used to classify road signs with the purpose to help the navigation of an hypotetical autonomous car. Since the initial results on the classification tasks of road signs using DBN are very good, we are pretty confident about the quality of the project. After that, we will consider the possibility to extend the task to other domains.
Boltzmann machines
| |
| Short Description: | Boltzmann machines for classification tasks |
| Coordinator: | MatteoMatteucci (matteo.matteucci@polimi.it) |
| Tutor: | MatteoMatteucci (matteo.matteucci@polimi.it), FrancescoVisin (visin@elet.polimi.it) |
| Collaborator: | |
| Students: | CarloDEramo (carlo.deramo@polimi.it) |
| Research Area: | Robotics |
| Research Topic: | Machine Learning |
| Start: | 2014/03/1 |
| Status: | Active |
| Level: | Ms |
Deep learning and Boltzmann machines
Deep learning is a set of algorithms in machine learning that attempt to model high-level abstractions in data by using architectures composed of multiple non-linear transformations. We will work on Boltzmann machines, an energy-based model which has been proven to perform very well in image and speech recognition tasks. A Boltzmann machines is composed of visible units representing the inputs of the network provided by the dataset and hidden units representing the feature detectors of the net. In a general fully connected Boltzmann machine each pair of unit is connected with a symmetric connection with a certain weights. We will focus on DBMs that are a particular type of Boltzmann machines built by stacking several layers of RBM on top of each other in a proper way. A RBM is known as restricted Boltzmann machines, a Boltzmann machines with no intra-layer connections. We'll study also deep belief network (DBN), a hybrid model between a neural network with discriminative and generative connections and a DBM, which has only symmetric connections. We will use Pylearn2 framework which offers training procedures of deep neural networks. During the project we will go deep in the analysis of this kind of networks studying their potentiality and flexibility; we'll try different configuration of networks in order to obtain the good performances we're looking for.
