Description

Foundation Models, especially Large Language Models (LLMs) and Large Multimodal Models (LMMs), have recently attracted a lot of interest in AI/ML research. Most of the work on Foundation Models has taken place in the context of natural language and image/video, but they hold promise for Cyber-Physical Systems (CPS) / Internet of Things (IoT) applications as well. However, the Foundation Models must cope with challenges unique to the CPS/IoT domain, such as dynamic environments, resource-constrained platforms, the impact of inference latency, appropriate handling of signal-level concepts such as sampling rates, etc. International Workshop on Foundation Models for Cyber-Physical Systems & Internet of Things (FMSys) provides a platform for researchers to exchange ideas and share their latest research findings to advance our understanding of Foundation Models in the CPS/IoT community. By fostering research and innovation in these domains, FMSys aims to shape the future trajectory of Foundation Models within the IoT landscape, driving transformative advancements and opening new avenues of exploration. FMSys 2024 is co-located with the CPS-IoT Week, the premier venue for research and development of cyber-physical systems.

Call for Papers

Foundation Models, especially Large Language Models (LLMs) and Large Multimodal Models (LMMs), have recently attracted a lot of interest in AI/ML research. Being trained using self-supervised learning methods on vast amounts of data, the Foundation Models have shown unprecedented abilities to handle, with minimal adaptation, a wide range of downstream tasks where, traditionally, one used bespoke task-specific machine learning pipelines. Most of the work on Foundation Models has taken place in the context of natural language and image/video, but they hold promise for CPS/IoT applications as well. Conventional machine learning pipelines trained using supervised learning remain the norm for processing sensor data and performing control actions in CPS/IoT. However, they are hungry for difficult-to-obtain annotated data and brittle to domain shifts caused by deployment time variations and dynamics in the physical environment, hardware platforms, and human subjects. Moreover, CPS-IoT applications often require higher-level spatiotemporal reasoning over sensory data, planning of actions, and meeting real-world regulations, all challenging tasks for task-specific models trained on limited data.

Foundation Models offer an opportunity to address these challenges in CPS-IoT via large-scale pooling of abundant but unlabeled sensory data from IoT devices, development of standardized multimodal embeddings for various sensor types, and training on diverse platform-task combinations to create reusable models with good generalization capabilities across tasks and deployments. However, the Foundation Models must also cope with challenges unique to the CPS/IoT domain, such as dynamic environments, resource-constrained platforms, the impact of inference latency, appropriate handling of signal-level concepts such as sampling rates, etc. FMSys Workshop will explore challenges and opportunities relating to Foundation Models in CPS-IoT systems. FMSys welcomes submissions from researchers from academia and industry that explore the latest developments in this area and encourages encompassing diverse domains, including sensing, systems, security, and applications.

Topics of interest include (but are not limited to)

  1. Foundation models on sensor data analytics, e.g., acoustic, light, motion, RF sensor.
  2. Benchmark datasets/evaluations of foundation models on sensor data.
  3. Applications of foundation models in healthcare, smart city, virtual reality, social media, etc..
  4. Foundation models for reasoning, planning, and control.
  5. Efficient fine-tuning and inference of foundation models for CPS/IoT applications.
  6. Novel machine learning (e.g., federated and multi-modal learning) systems based on foundation models.
  7. Foundation models for human-computer interaction or human-AI collaboration.
  8. Trending study of Penetrative AI that uses Large Language Models (LLMs) to support CPS/IoT applications.
  9. Trustworthiness of foundation models.
Submission requirements: Submissions should be original, unpublished research addressing the above topics. Each submission is a single PDF file no longer than six pages (two-column, 9-point), following ACM conference proceedings format (https://www.acm.org/publications/proceedings-template), including figures, references, etc. Submissions must include author names and affiliations for single-blind peer reviewing by the technical program
Sumission Site: https://fmsys24.hotcrp.com, If you have any questions regarding the workshop, please contact TPC chairs (Neiwen Ling neiwen.ling@yale.edu, Xiaomin Ouyang xmouyang23@ucla.edu)

Important Dates:

  • Registration Deadline: 18 Feb 2024 26 Feb 2024, 11:59 AM UTC
  • Paper Submission Deadline: 21 Feb 2024 4 Mar 2024, 11:59 AM UTC
  • Notification: 1 Mar 2024 13 Mar 2024
  • Camera ready: 9 Mar 2024, 20 Mar 2024, 11:59 AM UTC
  • Workshop date: 13 May 2024

  • Organizing Committee


    Technical Program Committee

    (List is ordered in alphabetical order)
    TPC Members Abdelwahed Khamis, CSIRO, Australia
    Fatima Anwar, UMass Amherst, USA
    Huajie Shao, William and Mary, USA
    Huatao Xu, Nanyang Technological University, Singapore
    JeongGil Ko, Yonsei University, South Korea
    Luis Garcia, University of Utah, USA
    Mengwei Xu, Beijing University of Posts and Telecommunications, China
    Mi Zhang, Ohio State University, USA
    Olga Saukh, Graz University of Technology, Austria
    Salma Elmalaki, University of California, Irvine, USA
    Stephen Xia, Northwestern University, USA
    Xian Shuai, Huawei Noah's Ark Lab, HK
    Shuochao Yao, George Mason University, USA
    Ting Cao, Microsoft Research, China
    Young D. Kwon, Samsung AI Center-Cambridge, UK
    Zhenyu Yan, CUHK, Hong Kong