1. [Best Paper Award] Ruinan Jin, Minghui Chen, Qiong Zhang and Xiaoxiao Li. F²L²: Forgettable Federated Linear Learning with Certified Data Removal
2. Yun-Wei Chu, Dong-Jun Han and Christopher Brinton. Only Send What You Need: Learning to Communicate Efficiently in Federated Multilingual Machine Translation
3. Holger Roth, Ziyue Xu, Yuan-Ting Hsieh, Adithya Renduchintala, Isaac Yang, Zhihong Zhang, Yuhong Wen, Sean Yang, Kevin Lu, Kristopher Kersten, Camir Ricketts, Daguang Xu, Chester Chen, Yan Cheng and Andrew Feng. Empowering Federated Learning for Massive Models with NVIDIA FLARE
4. Xiaoli Tang and Han Yu. Multi-Session Multi-Objective Budget Optimization for Auction-based Federated Learning
5. Xiaoli Tang, Han Yu, Run Tang, Chao Ren, Anran Li and Xiaoxiao Li. Dual Calibration-based Personalised Federated Learning
6. Zengxiang Li, Zhaoxiang Hou, Hui Liu, Tongzhi Li, Ying Wang, Chao Shi, Longfei Xie, Chengyi Yang, Weishan Zhang, Liang Xu and Zelei Liu. Federated Learning in Large Model Era: Vision-Language Model for Smart City Safety Operation Management
7. Zhihan Guo, Yifei Zhang, Zhuo Zhang, Zenglin Xu and Irwin King. FedLRC: Efficient Federated Low-Rank Adaption with Clustering for Multilingual Modeling
8. Mahdi Morafah, Matthias Reisser, Bill Lin and Christos Louizos. Stable Diffusion-based Data Augmentation for Federated Learning with Non-IID Data
9. Fiona Victoria Stanley Jothiraj and Afra Mashhadi. Phoenix: A Federated Generative Diffusion Model

Foundation models (FMs) are typically associated with large language models (LLMs), like ChatGPT, and are characterized by their scale and broad applicability. While these models provide transformative capabilities, they also introduce significant challenges, particularly concerning distributed model management and related data privacy, efficiency, and scalability. The training of foundation models is data and resource intensive and the conventional methods are typically centralized; this creates significant challenges including regulatory and privacy concerns in real-world use cases. These include distributed training data, computational resources to manage distributed data repositories, and development of and alignment with regulatory guidelines (e.g., GDPR) that restrict sharing sensitive data.

Federated learning (FL) is an emerging paradigm that can mitigate these challenges by training a global but distributed model using distributed data. The extensive application of machine learning to analyze and draw insight from real-world, distributed, and sensitive data necessitates familiarity with and adoption of this relevant and timely topic within the general scientific community. As FL allows self-interested data owners to collaboratively train models, end-users can become co-creators of AI solutions. By adopting federated learning approaches, we can leverage distributed data and computing power available across different sources while respecting user privacy.

The rise of FMs amplifies the importance and relevance of FL as a crucial research direction. With FMs becoming the norm in machine learning development, the focus shifts from model architecture design to tackling the issues surrounding privacy-preserving and distributed learning. Advancements in FL methods have the potential to unlock the use of FMs, enabling efficient and scalable training while safeguarding sensitive data.

With this in mind, we invite original research contributions, position papers, and work-in-progress reports on various aspects of federated learning in the era of foundation models. Since the emergence of foundation models has been a relatively recent phenomenon, their full impact on federated learning has not yet been well explored or understood. We hope to provide a platform to facilitate interaction among students, scholars, and industry professionals from around the world to discuss the latest advancements, share insights, and identify future directions in this exciting field. The workshop topics include but are not limited to:

Theory and algorithmic foundations: Impact of heterogeneity in FL of large models Multi-stage model training (e.g., base model + fine tuning) Optimization advances in FL (e.g., beyond first-order and local methods) Prompt tuning in federated settings Self-supervised learning in federated settings Leveraging foundation models to improve federated learning: Adaptive aggregation strategies for FL in heterogeneous environments Foundation model enhanced FL knowledge distillation Overcoming data interoperability challenges using foundation models Personalization of FL with foundation models

Federated learning for training and tuning foundation models: Fairness, bias, and interpretability challenges in FL with foundation models Federated transfer learning with foundation models FL techniques for traning large-scale foundation models Hardware for FL with foundation models Optimization algorithms for federated training of foundation models Privacy-preserving mechanisms in FL with foundation models Resource-efficient FL with foundation models Security and robustness considerations in FL with foundation models Systems and infrastructure for FL with foundation models Vertical federated learning with foundation models Vulnerabilities of FL with foundation models

More information on previous workshops can be found here.

Formatting Requirements. Submissions must be written in English, in double-column format, and must adhere to the ACM template and format (also available in Overleaf). Word users may use the Word Interim Template. The recommended setting for LaTeX is:

\documentclass\\sigconf, review\\{acmart}.

Submissions must be a single PDF file of up to 8 (eight) pages as main paper, with up to 2 additional pages for references and optional appendix.

Authorship. Submissions are not anonymous, hence authors should list their names and affiliations.

Submission site: https://easychair.org/conferences/?conf=thewebconf2024_workshops (make sure to select the "FL@FM-TheWebConf'24: International Workshop on Federated Foundation Models for the Web" track when making a submission).

For enquiries, please email to the workshop general/program co-chairs.

For accepted papers, it is up to the authors to decide if they want them to be included in the WWW'24 Companion proceedings. Doing so will make the paper regarded as published in an archival venue, and preclude it from being submitted to other conferences or journals. If the authors opt out of this option, their papers can still be submitted for consideration in other conferences and journals.

We will contact the authors of accepted papers in due course to make this decision at a later date.

• General Co-Chairs:
• Irwin King (The Chinese University of Hong Kong, Hong Kong)
• Guodong Long (University of Technology Sydney, Australia)
• Program Co-Chairs:
• Zenglin Xu (Harbin Institute of Technology, China)
• Han Yu (Nanyang Technological University, Singapore)
• Publication Co-Chairs:
• Lixin Fan (WeBank, China)
• Publicity Co-Chairs:
• Xu Guo (Nanyang Technological University, Singapore)
• Local Arrangement Co-Chairs:
• Xiaoli Tang (Nanyang Technological University, Singapore)