© University of Kent - Contact | Feedback | Legal | FOI | Cookies
Marek Grzes
Lecturer
|
|
|
Publications
My publications are available from the University of Kent's Academic Repository.
My full list of publications is here.
Teaching
In our school, we engage in collaborative teaching where most modules are shared between at least two people. I am involved in teaching the following modules:- Cognitive Neural Networks - CO836, CO636, and SP846 with Howard Bowman
- Data Mining and Knowledge Discovery - CO832 with Alex Freitas
- Concurrency and Parallelism - CO890 with Richard Jones, and Mark Batty
- Solving Problems with Data - CO584 with Colin Johnson
Research Interests
I belong to the following research groups:
PhD Students
My research interests include
- Sequential decision making and decision theory
- Simulation-based dynamic optimisation / reinforcement learning
Learning decision-making strategies using data or sampling from a real or a simulated environment. For example, an algorithm can learn how to play a game using a set of past games, or it can play against a human or a simulator in order to learn how to improve its behaviour. - Fully and partially observable Markov decision processes (MDPs and POMDPs)
Here, an algorithm knows the parameters (dynamics) of the game, and it can perform a direct optimisation of its own strategy.
- Simulation-based dynamic optimisation / reinforcement learning
- Machine learning and optimisation
- Probabilistic graphical models
- Compact and sparse representations for planning and reasoning
- Applications of machine learning and artificial intelligence
- Assistive technologies (e.g. intelligent assistants for people with cognitive disabilities)
- Chatbots
- Games
Professional Activities
Event Organiser
- The Eleventh International Workshop on Agents and Data Mining Interaction (ADMI) at Autonomous Agents and Multiagent Systems conference (AAMAS)
- ICAPS 2014 International Probabilistic Planning Competition (IPPC) Discrete Track, Co-organised with Jesse Hoey and Scott Sanner
- The 2011 Adaptive Learning Agents workshop (ALA) at Autonomous Agents and Multiagent Systems conference (AAMAS), Co-organised with Peter Vrancx and Matthew Knudson
- The 2010 Adaptive Learning Agents workshop (ALA) at Autonomous Agents and Multiagent Systems conference (AAMAS), Co-organised with Matthew Taylor
Programme Committee Member
- International Joint Conference on Artificial Intelligence (IJCAI), 2011, 2015, 2016, 2017
- Adaptive Learning Agents workshop (ALA) at Autonomous Agents and Multiagent Systems conference (AAMAS), 2009, 2012, 2013, 2014, 2015, 2017
- Autonomous Agents and Multiagent Systems Conference (AAMAS), 2010, 2011, 2014
- Canadian Conference on Artificial Intelligence (AI), 2013
- Simulation and AI in Games Conference (GAME-ON), 2010
Conference/ Workshop Reviewer
- International Conference on Artificial Intelligence and Statistics (AISTATS), 2016, 2017
- AAAI Conference on Artificial Intelligence (AAAI), 2016, 2017
- NIPS Workshop on Interpretable Machine Learning for Complex Systems (IMLCS), 2017
- International Conference on Machine Learning (ICML), 2013, 2014, 2015 (Reviewer Award), 2016
- ICML Workshop on Human Interpretability in Machine Learning (WHI), 2016
- Annual Conference on Neural Information Processing Systems (NIPS), 2015
- International Conference on Robotics and Automation (ICRA), 2012, 2013, 2014
- IEEE Symposium Series on Computational Intelligence (SSCI), 2014
- IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EPIROB), 2014
- Autonomous Agents and Multiagent Systems Conference (AAMAS), 2012
- International Conference on Automated Planning and Scheduling (ICAPS), 2011
- Intelligent Agent Technology Conference (IAT), 2008
Journal Reviewer
Artificial Intelligence in Medicine (AIIM); Cognitive Neurodynamics; Connection Science Journal (CS); Engineering Applications of Artificial Intelligence (EAAI); Frontiers of Computer Science (FSC); IEEE Transactions on Services Computing (SC); IEEE Transactions on Systems, Man, and Cybernetics (SMC); Journal of Artificial Intelligence Research (JAIR); Journal of Autonomous Agents and Multiagent Systems (JAAMAS); Journal of Information Science and Engineering (JISE); Machine Learning Journal (ML); The Knowledge Engineering Review Journal (KER)
Edited volumes
- Peter Vrancx, Matt Knudson and Marek Grzes (Eds.): Adaptive and Learning Agents, LNAI, Vol. 7113, Springer, 2012.
- Peter Vrancx, Matt Knudson and Marek Grzes (Eds.): Proceedings of AAMAS 2011 Workshop on Adaptive and Learning Agents (ALA 2011), Taipei, Taiwan, 2011 (pdf)
- Marek Grzes and Matthew E. Taylor (Eds.): Proceedings of AAMAS 2010 Workshop on Adaptive and Learning Agents (ALA 2010), Toronto, Canada, 2010 (pdf)
Software
- Incremental Policy Iteration for POMDPs
- Matrix Toolkits for Java optimised for MDPs
- Isomorph-free Branch and Bound Search for Finite State Controllers
- WEB-SNAP: POMDP-based Knowledge Engineering for Assistive Systems
- Evolutionary Learning of Decision Trees
- Small examples that I often find useful
Misc
- Linux configuration and useful commands
- A need to understand: that's what Marek likes in his research and teaching work
- Fun and games: that's what Marek likes in his work too
Related and Useful Links
- Documents
- Software
- APPL, a C++ implementation of the SARSOP algorithm
- dlib C++ machine learning library
- Fast Artificial Neural Network Library (FANN)
- GeNIe&SMILE: Influence diagrams and Bayesian networks modelling
- MDPSim: PPDDL Plan Evaluation Simulator
- Netlab neural network software
- Perseus and Symbolic Perseus
- PyBrain
- RL-Glue: Reinforcement Learning Glue
- ZMDP Software for POMDP and MDP Planning
- YALMIP advanced modelling of optimisation problems
Academic Genealogy
A fairly deep tree of my academic ancestors is here.
Mailing Address
Marek Grzes School of Computing University of Kent Canterbury, CT2 7NF United Kingdom
