Biography
I am a PhD student with Prof. Roberto Calandra at the Learning, Adaptive Systems, and Robotics (LASR) Lab at TU Dresden. My research focuses on model-based and hierarchical reinforcement learning applied to robotics.
Previously, I worked with Prof. Frank Fitzek on using machine learning in the context of communication networks and transportation systems.
Interests
- Reinforcement Learning
- Model-Predictive Control
- Sequence Modelling
- Generative Modelling
- Robotic Systems
- Intelligent Transportation Systems
- Communication Networks
Education
Dipl.-Ing. in Electrical Engineering, 2019
Technische Universität Dresden
Publications
(2022).
Optimizing Edge SLAM: Judicious Parameter Settings and Parallelized Map Updates.
In IEEE Global Communications Conference (GLOBECOM).
(2022).
Handover Predictions as an Enabler for Anticipatory Service Adaptations in Next-Generation Cellular Networks.
In IEEE ACM International Symposium on Mobility Management and Wireless Access (MobiWac).
(2022).
JAVRIS: Joint Artificial Visual Prediction and Control for Remote-(Robot) Interaction Systems.
In IEEE Consumer Communications & Networking Conference (CCNC).
(2020).
Optimised Traffic Light Management Through Reinforcement Learning: Traffic State Agnostic Agent vs. Holistic Agent With Current V2I Traffic State Knowledge.
In IEEE Open Journal of Intelligent Transportation Systems (OJ-ITS).
Grants & Awards
Awards
- Prize for outstanding final theses in information and communication technologies of the Saxonian Center of Telecommunication, 2020
- IEEE Open Journal of Intelligent Transportation Systems Best Paper Award, 2020
Reviewing & Editorial
Reviewing
- IEEE Systems Journal (x2)
- IEEE European Wireless (x2)
Teaching & Supervision
Teaching
- Fundamentals of Electrical Engineering 1 (WS20/21)
- Fundamentals of Electrical Engineering 2 (SS21)
- Communication Networks 3 (WS20/21, WS21/22)
Student Supervision
- Xianran Liu - Deep Reinforcement Learning for Handovers in Mobile Networks (Study Thesis)
- Nerea Fernandez-Sanchez - Joint Optimization of Traffic Signaling and Vehicle Speed Advise in V2I-Enabled Traffic with Deep Reinforcement Learning (Bachelor Thesis)
- Mao Xinwei - Investigation of Smart Routing and Queue Management for on the Fly Processing (Master Thesis)
- Adrian Bretschneider-Perez - AI aided robot remote control (Diploma Thesis)
- Hassine Chahed - Autonomous Transfer Learning Through the Use of a Context-Driven Artifact Description Language (Internship)
- Yueyue Gao - Investigation of Deep Reinforcement Learning for Routing in Software-defined Networks (Master Thesis)
- Robert Voelckner - Reinforcement Learning for Joint Control of Vehicles and Infrastructure in V2I-Enabled Traffic (Master Thesis)
- Xianran Liu - The Impact of Network Latency on Autonomous Traffic Controlled by Deep Reinforcement Learning (Diploma Thesis)
Contact
Please write me a message if you are interested in working with me.