© University of Kent - Contact | Feedback | Legal | FOI | Cookies
Marek Grzes
Lecturer / Year in Computing Course lead
![]() |
|
|
Publications
My publications are available from the University of Kent's Academic Repository.
My full list of publications is here.
Teaching
- Cognitive Neural Networks - COMP8360 and COMP6360 with Howard Bowman
- Data Mining and Knowledge Discovery - COMP8320 with Alex Freitas
- Solving Problems with Data and Text - COMP6481
Past Teaching
Research Interests
I belong to the following research groups:
PhD Students
- Mr Lee Harris
- Ms Lisa Bonheme
- Mr Piotr Sawicki
- Mr Théophile Champion (Howard Bowman main supervisor)
- Mr Peter Clapham
- Mr Declan Collins (Howard Bowman main supervisor)
Past Research Students
- Farhana Ferdousi Liza (Lecturer at the University of East Anglia)
PhD degree approved in 2020
Thesis title: Improving Training of Deep Neural Network Sequence Models - Adrian Wesek (Research Assistant at the University of Kent)
MSc by Research (2018-2019)
Thesis title: A Comprehensive Study of State-of-the-Art Word Embedding Algorithms for Natural Language Generation
My research interests include
- Sequential decision making and decision theory
- Simulation-based dynamic optimisation / reinforcement learning
Learning decision-making strategies using data or sampling from a real or a simulated environment. For example, an algorithm can learn how to play a game using a set of past games, or it can play against a human or a simulator in order to learn how to improve its behaviour. - Fully and partially observable Markov decision processes (MDPs and POMDPs)
Here, an algorithm knows the parameters (dynamics) of the game, and it can perform a direct optimisation of its own strategy.
- Simulation-based dynamic optimisation / reinforcement learning
- Machine learning and optimisation
- Probabilistic graphical models
- Compact and sparse representations for planning and reasoning
- Applications of machine learning and artificial intelligence
- Assistive technologies (e.g. intelligent assistants for people with cognitive disabilities)
- Chatbots
- Games
Professional Activities
Event Organiser
- The Eleventh International Workshop on Agents and Data Mining Interaction (ADMI) at Autonomous Agents and Multiagent Systems conference (AAMAS)
- ICAPS 2014 International Probabilistic Planning Competition (IPPC) Discrete Track, Co-organised with Jesse Hoey and Scott Sanner
- The 2011 Adaptive Learning Agents workshop (ALA) at Autonomous Agents and Multiagent Systems conference (AAMAS), Co-organised with Peter Vrancx and Matthew Knudson
- The 2010 Adaptive Learning Agents workshop (ALA) at Autonomous Agents and Multiagent Systems conference (AAMAS), Co-organised with Matthew Taylor
Senior Programme Committee Member
- AAAI Conference on Artificial Intelligence (AAAI), 2020
- Autonomous Agents and Multiagent Systems Conference (AAMAS), 2020
- International Joint Conference on Artificial Intelligence (IJCAI), 2019
Programme Committee Member
- Workshop on Data Mining for Ageing, Rehabilitation and Independent Assisted Living (ARIAL) at International Conference on Data Mining (ICDM), 2017
- International Joint Conference on Artificial Intelligence (IJCAI), 2011, 2015, 2016, 2017
- Adaptive Learning Agents workshop (ALA) at Autonomous Agents and Multiagent Systems conference (AAMAS), 2009, 2012, 2013, 2014, 2015, 2017
- Autonomous Agents and Multiagent Systems Conference (AAMAS), 2010, 2011, 2014, 2018
- Canadian Conference on Artificial Intelligence (AI), 2013
- Simulation and AI in Games Conference (GAME-ON), 2010
Conference/ Workshop Reviewer
- ACM Conference on Electronic Commerce (EC), 2018
- Annual Conference on Neural Information Processing Systems (NeurIPS), 2015, 2017, 2018, 2019, 2020
- ICML Workshop on Human Interpretability in Machine Learning (WHI), 2016, 2017
- International Conference on Machine Learning (ICML), 2013, 2014, 2015 (Reviewer Award), 2016, 2017
- International Conference on Artificial Intelligence and Statistics (AISTATS), 2016, 2017, 2018
- AAAI Conference on Artificial Intelligence (AAAI), 2016, 2017
- NIPS Workshop on Interpretable Machine Learning for Complex Systems (IMLCS), 2017
- International Conference on Robotics and Automation (ICRA), 2012, 2013, 2014
- IEEE Symposium Series on Computational Intelligence (SSCI), 2014
- IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EPIROB), 2014
- Autonomous Agents and Multiagent Systems Conference (AAMAS), 2012
- International Conference on Automated Planning and Scheduling (ICAPS), 2011
- Intelligent Agent Technology Conference (IAT), 2008
Journal Reviewer
Artificial Intelligence in Medicine (AIIM); Cognitive Neurodynamics; Connection Science Journal (CS); Engineering Applications of Artificial Intelligence (EAAI); Frontiers of Computer Science (FSC); IEEE Transactions on Services Computing (SC); IEEE Transactions on Systems, Man, and Cybernetics (SMC); Journal of Artificial Intelligence Research (JAIR); Journal of Autonomous Agents and Multiagent Systems (JAAMAS); Journal of Information Science and Engineering (JISE); Machine Learning Journal (ML); The Knowledge Engineering Review Journal (KER); IEEE Transactions on Affective Computing; Neural Computing and Applications
Edited volumes
- Peter Vrancx, Matt Knudson and Marek Grzes (Eds.): Adaptive and Learning Agents, LNAI, Vol. 7113, Springer, 2012.
- Peter Vrancx, Matt Knudson and Marek Grzes (Eds.): Proceedings of AAMAS 2011 Workshop on Adaptive and Learning Agents (ALA 2011), Taipei, Taiwan, 2011 (pdf)
- Marek Grzes and Matthew E. Taylor (Eds.): Proceedings of AAMAS 2010 Workshop on Adaptive and Learning Agents (ALA 2010), Toronto, Canada, 2010 (pdf)
Software
- Incremental Policy Iteration for POMDPs
- Matrix Toolkits for Java optimised for MDPs
- Isomorph-free Branch and Bound Search for Finite State Controllers
- WEB-SNAP: POMDP-based Knowledge Engineering for Assistive Systems
- Evolutionary Learning of Decision Trees
- Small examples that I often find useful
Misc
- Linux configuration and useful commands
- A need to understand: that's what Marek likes in his research and teaching work
- Fun and games: that's what Marek likes in his work too
Related and Useful Links
- Documents
- Software
- APPL, a C++ implementation of the SARSOP algorithm
- dlib C++ machine learning library
- Fast Artificial Neural Network Library (FANN)
- GeNIe&SMILE: Influence diagrams and Bayesian networks modelling
- MDPSim: PPDDL Plan Evaluation Simulator
- Netlab neural network software
- Perseus and Symbolic Perseus
- PyBrain
- RL-Glue: Reinforcement Learning Glue
- ZMDP Software for POMDP and MDP Planning
- YALMIP advanced modelling of optimisation problems
Academic Genealogy
A fairly deep tree of my academic ancestors is here.
Mailing Address
Marek Grzes School of Computing University of Kent Canterbury, CT2 7NF United Kingdom