AIRWiki - User contributions [en]

Machine Learning

2010-05-15T12:25:28Z

RafaelVilella: /* Ongoing Projects */

Machine Learning is the field in Artificial Intelligence dealing with models and algorithms to develop computer programs able to improve their performance during execution.

This reasearch field includes several learning pradigms (e.g., supervised learning, unsupervised learning, and reinforcement learning) or techniques (e.g., neural networks, genetic algorithms, decision trees, etc.). Recently all these techniques have been applied to Data Mining that can be thought as the natural complementation between Statistics, Artificial Intelligence, and Databases. Its main goal is to develop algorithms and techniques to extract knowledge from huge data repositories.

== Ongoing Projects ==
{{#ask: [[Category:Project]][[prjResArea::{{PAGENAME}}]][[PrjEnd::>{{CURRENTYEAR}}/{{CURRENTMONTH}}/{{CURRENTDAY}}]]|?prjTitle = |format=ul}}

Batch Learning for Poker
http://airwiki.elet.polimi.it/mediawiki/index.php/Batch_Learning_for_Poker

== Project Proposals ==
{{#ask: [[Category:ProjectProposal]]
[[PrjResArea::{{PAGENAME}}]]|
?PrjTitle |
?PrjImage |
?PrjDescription |
?PrjTutor |
?PrjStarts |
?PrjStudMin |
?PrjStudMax |
?PrjCFUMin |
?PrjCFUMax |
?PrjResArea |
?PrjResTopic |
?PrjLevel |
?PrjType |
format = template |
template = Template:ProjectProposalVizSlim
}}

== People ==

{{#ask: [[HasResArea::{{PAGENAME}}]] | format=ul}}

==Past Projects==

{{#ask: [[Category:Project]][[prjResArea::{{PAGENAME}}]][[PrjEnd::<{{CURRENTYEAR}}/{{CURRENTMONTH}}/{{CURRENTDAY}}]] |format=ul}}

[[Category:Research Area]]

Batch Learning for Poker

2010-05-15T12:22:57Z

RafaelVilella:

{{Project
|title=MRT: Batch Learning for Poker
|coordinator=MarcelloRestelli
|students=RafaelVilella
|resarea=Machine Learning
|start=2010/03/01
|end=1970/01/01
|status=Active
|type=Thesis
}}
=== Project short description ===

This project is aimed at determination an efficient policy to play Poker Limit Hold`em Heads up. Subdivided in three major areas:
1- Analysis of rules of poker and player strategies.
2- Feature Extraction: Given the fact that number of possible states are quite large (10E14). A FS approach is necessary.
3- Fitted Q-Iteration to determinate the policy using Extremely Randomized Trees.

=== Dates ===
Start date: 2010/03/01

End date: Still in progress

===== Project head(s) =====

M.Restelli - [[User:MarcelloRestelli]]

===== Students currently working on the project =====

Rafael Domingues Santos Vilella - [[User:RafaelVilella]]

=== Laboratory work and risk analysis ===

This project is related to software developing so there are no dangerous activities

Batch Learning for Poker

2010-05-15T12:22:18Z

RafaelVilella: /* Project short description */

{{Project
|title=MRT: Batch Learning for Poker
|coordinator=MarcelloRestelli
|students=RafaelVilella
|resarea=Machine Learning
|start=2010/03/01
|end= In progress
|status=Active
|type=Thesis
}}

=== Project short description ===

This project is aimed at determination an efficient policy to play Poker Limit Hold`em Heads up. Subdivided in three major areas:
1- Analysis of rules of poker and player strategies.
2- Feature Extraction: Given the fact that number of possible states are quite large (10E14). A FS approach is necessary.
3- Fitted Q-Iteration to determinate the policy using Extremely Randomized Trees.

=== Dates ===
Start date: 2010/03/01

End date: Still in progress

===== Project head(s) =====

M.Restelli - [[User:MarcelloRestelli]]

===== Students currently working on the project =====

Rafael Domingues Santos Vilella - [[User:RafaelVilella]]

=== Laboratory work and risk analysis ===

This project is related to software developing so there are no dangerous activities

Machine Learning

2010-05-15T12:21:10Z

RafaelVilella: /* Ongoing Projects */

Machine Learning is the field in Artificial Intelligence dealing with models and algorithms to develop computer programs able to improve their performance during execution.

This reasearch field includes several learning pradigms (e.g., supervised learning, unsupervised learning, and reinforcement learning) or techniques (e.g., neural networks, genetic algorithms, decision trees, etc.). Recently all these techniques have been applied to Data Mining that can be thought as the natural complementation between Statistics, Artificial Intelligence, and Databases. Its main goal is to develop algorithms and techniques to extract knowledge from huge data repositories.

== Ongoing Projects ==
{{#ask: [[Category:Project]][[prjResArea::{{PAGENAME}}]][[PrjEnd::>{{CURRENTYEAR}}/{{CURRENTMONTH}}/{{CURRENTDAY}}]]|?prjTitle = |format=ul}}

http://airwiki.elet.polimi.it/mediawiki/index.php/Batch_Learning_for_Poker

== Project Proposals ==
{{#ask: [[Category:ProjectProposal]]
[[PrjResArea::{{PAGENAME}}]]|
?PrjTitle |
?PrjImage |
?PrjDescription |
?PrjTutor |
?PrjStarts |
?PrjStudMin |
?PrjStudMax |
?PrjCFUMin |
?PrjCFUMax |
?PrjResArea |
?PrjResTopic |
?PrjLevel |
?PrjType |
format = template |
template = Template:ProjectProposalVizSlim
}}

== People ==

{{#ask: [[HasResArea::{{PAGENAME}}]] | format=ul}}

==Past Projects==

{{#ask: [[Category:Project]][[prjResArea::{{PAGENAME}}]][[PrjEnd::<{{CURRENTYEAR}}/{{CURRENTMONTH}}/{{CURRENTDAY}}]] |format=ul}}

[[Category:Research Area]]

Batch Learning for Poker

2010-05-15T12:03:53Z

RafaelVilella:

Batch Learning for Poker

2010-05-15T12:01:07Z

RafaelVilella:

{{Project
|title=MRT: Batch Learning for Poker
|coordinator=MarcelloRestelli
|students=RafaelVilella
|resarea=Machine Learning
|start=2010/03/01
|end= In progress
|status=Active
|type=Thesis
}}

=== Project short description ===

This project is aimed at determination an efficient policy to play Poker Limit Hold`em Heads up. Subdivided in three major areas:
1- Analysis of rules of poker and player strategies.
2- Feature Extraction: Given the fact that number of possible states are quite large (10E14). A FS approach is necessary.
3- Fitted Q-Iteration to determinate the policy using Extremely Randomized Trees.

=== Dates ===
Start date: 2010/03/01

End date: Still in progress

=== Website(s) ===

===== Project head(s) =====

M.Restelli - [[User:MarcelloRestelli]]

===== Other Politecnico di Milano people =====

===== Students currently working on the project =====

Rafael Domingues Santos Vilella - [[User:RafaelVilella]]

===== Students who worked on the project in the past =====

===== External personnel: =====

=== Laboratory work and risk analysis ===

This project is related to software developing so there are no dangerous activities

User:RafaelVilella

2010-05-13T16:03:33Z

RafaelVilella:

{{Student
|category=Student
|firstname=Rafael
|lastname=Domingues Santos Vilella
|photo=Eu_perfil.png‎
|email=rafaelcarioca51@gmail.com
|projectpage=Batch Learning for Poker
|advisor=MarcelloRestelli;
|status=active
}}
Rafael Dominges Santos Vilella was born 13 march 1985, Brazil, Rio de Janeiro. He`s a double degree student (T.I.M.E). In Brazil a degree in Meccatronics Engineering at Escola Politecnica da Universidade de São Paulo. In Italy he is concluding his study in Automation Engineering. His thesis will be focused in developing artificial intelligence for poker.

User:RafaelVilella

2010-05-13T16:02:32Z

RafaelVilella:

{{Student
|category=Student
|firstname=Rafael
|lastname=Domingues Santos Vilella
|photo=Image:Eu_perfil.png‎
|email=rafaelcarioca51@gmail.com
|projectpage=Batch Learning for Poker
|advisor=MarcelloRestelli;
|status=active
}}
Rafael Dominges Santos Vilella was born 13 march 1985, Brazil, Rio de Janeiro. He`s a double degree student (T.I.M.E). In Brazil a degree in Meccatronics Engineering at Escola Politecnica da Universidade de São Paulo. In Italy he is concluding his study in Automation Engineering. His thesis will be focused in developing artificial intelligence for poker.

User:RafaelVilella

2010-05-13T15:59:41Z

RafaelVilella:

{{Student
|category=Student
|firstname=Rafael
|lastname=Domingues Santos Vilella
|photo=[[Image:File.jpg]]
|email=rafaelcarioca51@gmail.com
|projectpage=Batch Learning for Poker
|advisor=MarcelloRestelli;
|status=active
}}
Rafael Dominges Santos Vilella was born 13 march 1985, Brazil, Rio de Janeiro. He`s a double degree student (T.I.M.E). In Brazil a degree in Meccatronics Engineering at Escola Politecnica da Universidade de São Paulo. In Italy he is concluding his study in Automation Engineering. His thesis will be focused in developing artificial intelligence for poker.

User:RafaelVilella

2010-05-13T12:03:43Z

RafaelVilella:

{{Student
|category=Student
|firstname=Rafael
|lastname=Domingues Santos Vilella
|email=rafaelcarioca51@gmail.com
|projectpage=http://airwiki.elet.polimi.it/mediawiki/index.php/Batch_Learning_for_Poker
|advisor=MarcelloRestelli;
|status=active
}}

Rafael Dominges Santos Vilella was born 13 march 1985, Brazil, Rio de Janeiro. He`s a double degree student (T.I.M.E). In Brazil a degree in Meccatronics Engineering at Escola Politecnica da Universidade de São Paulo. In Italy he is concluding his study in Automation Engineering. His thesis will be focused in developing artificial intelligence for poker.

User:RafaelVilella

2010-05-13T11:49:25Z

RafaelVilella:

{{Student
|category=Student
|firstname=Rafael
|lastname=Domingues Santos Vilella
|email=rafaelcarioca51@gmail.com
|projectpage=http://airwiki.elet.polimi.it/mediawiki/index.php/Batch_Learning_for_Poker
|advisor=MarcelloRestelli;
|status=active
}}
Rafael Domingues Santos Vilella è nato il 13 di marzo in Brasile, Rio de Janeiro. E' studente TIME, sta per finire Ingegneria dell'automazione al Politecnico di Milano e Ingegneria meccatronica alla EPUSP, Escola Politecnica da Universidade de São Paulo. A Milano presenterà sua tesi nel campo di sviluppo di intelligenza artificiale (reinforcement learning) in Poker.

Batch Learning for Poker

2010-05-13T11:48:59Z

RafaelVilella: New page: ' == '''Part 1: project profile''' == === Project name === Batch Learning for Poker === Project short description === This project is aimed at determination an efficient policy to play...

'
== '''Part 1: project profile''' ==

=== Project name ===

Batch Learning for Poker

=== Project short description ===

This project is aimed at determination an efficient policy to play Poker Limit Hold`em Heads up. Subdivided in three major areas:
1- Analysis of rules of poker and player strategies.
2- Feature Extraction: Given the fact that number of possible states are quite large (10E14). A FS approach is necessary.
3- Fitted Q-Iteration to determinate the policy using Extremely Randomized Trees.

=== Dates ===
Start date: 2010/03/01

End date: Still in progress

=== Website(s) ===

===== Project head(s) =====

M.Restelli - [[User:MarcelloRestelli]]

===== Other Politecnico di Milano people =====

===== Students currently working on the project =====

Rafael Domingues Santos Vilella - [[User:RafaelVilella]]

===== Students who worked on the project in the past =====

===== External personnel: =====

=== Laboratory work and risk analysis ===

This project is related to software developing so there are no dangerous activities

Projects

2010-05-13T11:18:53Z

RafaelVilella: /* Machine Learning */

This page is a repository of links to the pages describing the '''projects''' we are currently working on at AIRLab.
See the list of our finished projects on the [[Finished Projects]] page.

== Ongoing projects ==
''by research area (areas are defined in the [[Main Page]]); for each project a name and a link to its AIRWiki page is given''

=== [[Agents, Multiagent Systems, Agencies]] ===
----
===== [[Strategic Robot Patrolling]] =====

===== [[Evolutionary game theory for biology]] =====
===== [[Game theoretic analysis of electric power]] =====
===== [[Algorithms for computing equilibria]] =====
===== [[Multiagent cooperation|Multiagent cooperating system]] =====
===== [[Planning in Ambient Intelligence scenarios]] =====
===== [[Real-Time Strategy Games]] =====

=== [[BioSignal Analysis]] ===
----
===== [[Affective Computing]] =====

{{#ask: [[Category:Project]][[prjResTopic::Affective_Computing]][[PrjEnd::>{{CURRENTYEAR}}/{{CURRENTMONTH}}/{{CURRENTDAY}}]] |format=ul}}

===== [[Brain-Computer Interface]] =====
* [[BCI based on Motor Imagery]]
** [[Predictive BCI Speller based on Motor Imagery]] (Master thesis, Tiziano D'Albis)
** [[Feature Selection and Extraction for a BCI based on motor imagery]] (Master thesis, Francesco Amenta)
** [[Integrating Motor Imagery and Error Potentials in a Brain-Computer Interface]] (Master Thesis, Paolo Calloni)
** [[Ocular Artifacts Filter implementation for a BCI based on motor imagery]] (First Level thesis, Fabio Beltramini)
* [[Online automatic tuning of the number of repetitions in a P300-based BCI]] (First Level thesis, Siegfried Cattaneo)
* [[Graphical user interface for an autonomous wheelchair]] (First Level thesis, Antonio Tripodi and Eleonora Ciceri)
* [[Mu and beta rhythm-based BCI]]
* [[Reproduction of an algorithm for the recognition of error potentials]]
* [[Stimulus tagging using aperiodic visual stimulation in a VEP-based BCI]]

===== [[Automatic Detection Of Sleep Stages]] =====
* [[Sleep Staging with HMM]]

===== [[Analysis of the Olfactory Signal]] =====
* [[Lung Cancer Detection by an Electronic Nose]]
* [[HE-KNOWS - An electronic nose]]

===== [[Classification of EMG signals]] =====

=== [[Computer Vision and Image Analysis]] ===
----
* [[Automated extraction of laser streaks and range profiles]]
* [[Data collection for mutual calibration|Data collection for laser-rangefinder and camera calibration]]
* [[Image retargeting by k-seam removal]]
* [[Particle filter for object tracking]]
* [[Template based paper like reconstruction when the edges are straight]]
* [[Wii Remote headtracking and active projector]]
* [[Vision module for the Milan Robocup Team]]
* [[Long Exposure Images for Resource-constrained video surveillance]]
* [[NonPhotorealistic rendering of speed lines]].
* [[Restoration of blurred objects using cues from the alpha matte]]
* [[Analyzing Traffic Speed From a Single Night Image - Light Streaks Detection]]
* [[Plate detection algorithm]]
* [[A vision-based 3D input device for space curves]]
* [[Correlation-based 3D reconstruction with pan/tilt stereo-camera]]
* [[Inverse scaling parametrization for Monocular Simultaneous Localization and Mapping]]
* [[Image resize by solving a sparse linear system]]
* [[Monocular Simultaneous Localization And Mapping with Moving Object Tracking using Conditional Independent submaps]]
* [[Robust data association for high-speed SLAM]]
* [[Automated Recognition between alkaline and non-alkaline AA batteries]]
* [[Hand gesture guided desktop lamp]]

=== [[Machine Learning]] ===
----
* [[Adaptive Reinforcement Learning Multiagent Coordination in Real-Time Computer Games|Adaptive Reinforcement Learning Multiagent Coordination in Real-Time Computer Games]]
* [[B-Smart Behaviour Sequence Modeler and Recognition tool|B-Smart Behaviour Sequence Modeler and Recognition tool]]
* [[Giskar - Distance estimation through single camera features applied to Neural Networks]]
* [[Exploit of betting patterns using genetic algorithms and reinforcement learning]]

* [[Q_Fitted_Algorithm:_The_Dam_Problem]]

* [[Batch Learning for Poker]]

=== [[Evolutionary Computation]] ===
----

* [[Evoptool: Evolutionary Optimization Tool]]

=== [[Philosophy of Artificial Intelligence]] ===
----

=== [[Robotics]] ===
----

==== [[Robot development]] ====
* [[ExhiBot - A robot for exhibitions]]
* [[LURCH - The autonomous wheelchair]]
* [[Balancing robots: Tilty, TiltOne]]
* [[Robotizing a Golf Cart ]]
* [[ Development of a neck for humanoid robot ]]
* [[Development of robot Maximum One - control and programming ]]
* [[Milan Robocup Team Robot development ]]
* [[Modular Robotic Toolkit ]]
* [[Indoor localization system based on a gyro and visual passive markers]]
* [[Simulation of a 6 DOF Manipulator]]
* [[Warugadar - Fusion piezoelettric and vision controllers with PYRO]]

==== [[Benchmarking]] ====
* [[Rawseeds|RAWSEEDS]]

==== [[Bio Robotics]] ====
* [[PoliManus]]
* [[ZOIDBERG - An autonomous bio-inspired RoboFish]]
* [[Styx The 6 Whegs Robot]]
* [[PolyGlove: a body-based haptic interface]]
* [[ULISSE]]
* [[PEKeB: a PiezoElectric KeyBoard]]
* [[Anthropomorphic Robotic Wrist]]
* [[High-level architecture for the control of humanoid robot]]
* [[Zoidberg II, powering robot fish]]
* [[EMG, new test]]
* [[CPG for Warugadar]]
* [[Hand prosthesis using robotics principles]]
* [[Control of Whitefinger]]

==== [[Robogames]] ====
* [[ROBOWII]]
* [[RobogameDesign]]

==== [[Navigation Strategies]] ====
* [[ Navigation system for LURCH ]]

=== [[Social Software and Semantic Web]] ===
----
===== [[Social Network Analysis| Extracting Knowledge From Social Networks]] =====

{{#ask: [[Category:Project]][[prjResTopic::Social Network Analysis]][[prjStatus::Active]]|?prjTitle = |format=ul}}

===== [[Semantic Tagging]] =====

{{#ask: [[Category:Project]][[prjResTopic::Semantic Tagging]][[prjStatus::Active]]|?prjTitle = |format=ul}}

===== [[Semantic Search]] =====

{{#ask: [[Category:Project]][[prjResTopic::Semantic Search]][[prjStatus::Active]]|?prjTitle = |format=ul}}



== Past projects ==

=== [[BioSignal Analysis]] ===

===== [[Affective Computing]] =====

{{#ask: [[Category:Project]][[prjResTopic::Affective_Computing]] [[PrjEnd::<{{CURRENTYEAR}}/{{CURRENTMONTH}}/{{CURRENTDAY}}]]|format=ul}}

===== [[Brain-Computer Interface]] =====
* [[Online P300 and ErrP recognition with BCI2000]]

=== [[Robotics]] ===
*[[2D Mapping Using a Quadtree Data Structure]]

== April Fool's projects ==

Following the [http://en.wikipedia.org/wiki/April_Fools%27_Day_RFC RFC] tradition,
[[April_1st_Projects|here]] is our April Fool's project page.

== Note for students ==

If you are a student and there isn't a '''page describing your project''', this is because YOU have the task of creating it and populating it with (meaningful) content. If you are a student and there IS a page describing your project, you have the task to complete that page with (useful and comprehensive) information about your own contribution to the project. Be aware that the quality of your work (or lack of it) on the AIRWiki will be evaluated by the Teachers and will influence your grades.

Instructions to add a new project or to add content to an existing project page are available at [[Projects - HOWTO]].

User:RafaelVilella

2010-05-13T11:16:15Z

RafaelVilella:

{{Student
|category=Student
|firstname=Rafael
|lastname=Domingues Santos Vilella
|email=rafaelcarioca51@gmail.com
|advisor=MarcelloRestelli;
|status=active
}}
Rafael Domingues Santos Vilella è nato il 13 di marzo in Brasile, Rio de Janeiro. E' studente TIME, sta per finire Ingegneria dell'automazione al Politecnico di Milano e Ingegneria meccatronica alla EPUSP, Escola Politecnica da Universidade de São Paulo. A Milano presenterà sua tesi nel campo di sviluppo di intelligenza artificiale (reinforcement learning) in Poker.

File:Eu perfil.png

2010-05-13T11:14:00Z

RafaelVilella: uploaded a new version of "Image:Eu perfil.png"

User:RafaelVilella

2010-05-13T11:11:08Z

RafaelVilella:

{{Student
|category=Student
|firstname=Rafael
|lastname=Domingues Santos Vilella
|photo=http://airwiki.elet.polimi.it/mediawiki/index.php/Image:Eu_perfil.png
|email=rafaelcarioca51@gmail.com
|advisor=MarcelloRestelli;
|status=active
}}
Rafael Domingues Santos Vilella è nato il 13 di marzo in Brasile, Rio de Janeiro. E' studente TIME, sta per finire Ingegneria dell'automazione al Politecnico di Milano e Ingegneria meccatronica alla EPUSP, Escola Politecnica da Universidade de São Paulo. A Milano presenterà sua tesi nel campo di sviluppo di intelligenza artificiale (reinforcement learning) in Poker.

User:RafaelVilella

2010-05-13T11:08:17Z

RafaelVilella:

{{Student
|category=Student
|firstname=Rafael
|lastname=Domingues Santos Vilella
|email=rafaelcarioca51@gmail.com
|advisor=Marcello Restelli
|status=active
}}
Rafael Domingues Santos Vilella è nato il 13 di marzo in Brasile, Rio de Janeiro. E' studente TIME, sta per finire Ingegneria dell'automazione al Politecnico di Milano e Ingegneria meccatronica alla EPUSP, Escola Politecnica da Universidade de São Paulo. A Milano presenterà sua tesi nel campo di sviluppo di intelligenza artificiale (reinforcement learning) in Poker.

File:Eu perfil.png

2010-04-28T20:10:44Z

RafaelVilella:

User:RafaelVilella

2010-04-28T20:07:23Z

RafaelVilella: New page: Rafael Domingues Santos Vilella è nato il 13 di marzo in Brasile, Rio de Janeiro. E' studente TIME, sta per finire Ingegneria dell'automazione al Politecnico di Milano e Ingegneria meccat...

Rafael Domingues Santos Vilella è nato il 13 di marzo in Brasile, Rio de Janeiro. E' studente TIME, sta per finire Ingegneria dell'automazione al Politecnico di Milano e Ingegneria meccatronica alla EPUSP, Escola Politecnica da Universidade de São Paulo. A Milano presenterà sua tesi nel campo di sviluppo di intelligenza artificiale (reinforcement learning) in Poker.