PaperHub
6.6
/10
Poster5 位审稿人
最低5最高8标准差1.2
8
6
6
8
5
2.8
置信度
正确性2.8
贡献度2.8
表达3.4
ICLR 2025

Neural Multi-Objective Combinatorial Optimization via Graph-Image Multimodal Fusion

Jinbiao Chen,Jiahai Wang,Zhiguang Cao,Yaoxin Wu
OpenReviewPDF
提交: 2024-09-28更新: 2025-03-14
TL;DR

This paper proposes a graph-image multimodal fusion framework for neural multi-objective combinatorial optimization.

摘要

关键词
Neural Multi-Objective Combinatorial OptimizationMultimodal FusionDeep Reinforcement Learning

评审与讨论

审稿意见
8

This paper proposes a generic graph-image multimodal fusion (GIMF) framework that integrates graph and image information of the problem instances to enhance neural MOCO. The framework consists of three main components: (1) a constructed coordinate image (2) a problem-size adaptive resolution strategy and (3) a multimodal fusion mechanism. Experimental results demonstrate its effectiveness.

优点

  1. This paper is well-organized and clear writing.
  2. The proposed method demonstrates novelty.
  3. Experiments show that GIMF performs better on classic MOCO problems.

缺点

Some details and parameter settings were not explained clearly (see Questions below).

问题

  1. What does "πi\bm{\pi_i}" represent in the formula for calculating ∇L(θ)\nabla\mathcal{L}(\bm{\theta}) on line 136, or should it be changed to "πi\pi_i"?

  2. What is the meaning of the line from πt\pi_t to hch_c in Figure 2? The authors should supplement the relationship between πt\pi_t and hch_c in the main text.

  3. Why choose the dimension of patch as w=h=16w=h=16? The authors should provide an explanation or conduct ablation experiments.

审稿意见
6

This paper introduces a novel approach for MOCO through graph-image multimodal fusion. The framework incorporates a constructed coordinate image and efficient multimodal fusion. Experimental results on MOCO problems show the advance of the proposed GIMF.

优点

S1. The GIMF framework successfully combines graph and image information, enriching representation learning for MOCO problems.

S2. The PSAR strategy and modality-specific bottlenecks for multimodal fusion are well-justified and empirically validated.

S3. Extensive experiments are conducted.

缺点

W1. The improvement achieved by the proposed methods appears to be marginal.

W2. The computational cost of the proposed GIMF framework seems considerably higher than state-of-the-art methods like EMNH. It seems that the performance gains come from a cost of efficiency.

W3. Constructing images seems relatively straightforward for TSP problems, but how does this approach generalize to other real-world scenarios? For some tasks, image construction may be challenging—how do the authors envision addressing this limitation?

问题

N/A.

审稿意见
6

This paper presents a novel Graph-Image Multimodal Fusion (GIMF) framework designed to enhance multi-objective combinatorial optimization (MOCO) methods. By integrating both graph and image information from problem instances, the framework effectively addresses the limitations associated with relying solely on graph-modal information, particularly in the context of bi- and tri-objective traveling salesman problems (TSP).

优点

  • The main novelty of this paper lies in defining the image modality alongside the graph modality, offering a new perspective for addressing challenges in MOCO.
  • This approach enhances conventional heuristic algorithms by leveraging the combined information from both modalities.

缺点

  • If the image modality has been defined, why still continue to use the graph modality? How could one approach solving an MOCO problem using only the image modality? Additionally, could you provide ablation studies to support this?
  • Since the graph can also be viewed as a transition matrix, what is the relationship between reinforcement learning and the authors' algorithm?

问题

  • Is this analogous to a game played on a chessboard? Are the authors providing definitions and citations related to reinforcement learning? Are you aiming to transform the graph problem into a gameplay problem on a chessboard?
  • Has reinforcement learning for MOCO in chessboard games been well studied elsewhere? If MOCO, such as TSP, is defined within the context of a chessboard game, isn’t it relatively straightforward? Does this require a graph modality, or can the image modality defined by the authors alone be sufficient to address the MOCO problems?
审稿意见
8

The paper presents a novel graph-image multimodal fusion (GIMF) framework that aims to enhance neural multi-objective combinatorial optimization (MOCO) methods. The GIMF framework integrates graph and image information of problem instances, which is designed to overcome the limitations of existing neural MOCO methods that rely solely on graph-modal information. The main contribution of the proposed method is the coordinate image construction, which provides complementary information to the graph representation.To improve the model's generalization across different problem sizes, a Problem-size Adaptive Resolution (PSAR) strategy is proposed during the image construction process, which helps maintain a stable density for both the image and patches. A multimodal fusion mechanism with Modality-Specific Bottlenecks (MSB) is designed to efficiently couple graph and image information.

The GIMF framework is implemented with two state-of-the-art neural MOCO backbones, namely CNH and PMOCO. Experimental results on classic MOCO problems demonstrate that GIMF can improve neural MOCO methods by providing image-modal information and exhibits superior generalization capability.

优点

  1. The major contribution of this paper is its integration of both graph and image modalities to enhance the representation learning for MOCO problems. The construction of coordinate images and the use of PSAR strategy are innovative steps that address the limitations of relying solely on graph information. The proposed MSB in multimodal fusion mechanism is also a novel contribution.

  2. The paper is well-organized and written in a clear and concise manner. The introduction effectively sets the stage by outlining the challenges in MOCO and the motivation behind the GIMF framework. The preliminary section clearly describes the definition of the MOCO problem and related concepts, as well as the graph transformer for MOCO. The methodology section is detailed, providing a clear explanation of the image construction process, the PSAR strategy, and the multimodal fusion mechanism.

  3. The significance mainly comes from its novelty.Specifically, leveraging a multimodal approach that incorporates image-modal information, which has the potential to improve many existing neural MOCO methods. The paper is also likely to inspire further research in constructing and learning from images of MOCO problems.

  4. The experimental results suggest that GIMF does not obviously increase computational time of the neural MOCO basebone. The major innovations PSAR and MSB are validated by ablation study.

缺点

The proposed method could improve the performance of CNH and PMOCO, as well as their augment variants. However, sometimes the improvement seems marginal. In Table 1 and Table 2, the reported improvements are all mostly less than 0.001, and sometimes are as small as 0.0001. Meanwhile, the reported best results can not significantly outperform SOTA baselines.

问题

In Table 1 and Table 2, the reported times of GIMF-P and GIMF-C are sometimes smaller than PMOCO and CHN, what is the reason for this phenomenon?

审稿意见
5

This paper aims to fully leverage the intrinsic features of problem instances by proposing a novel graph-image multimodal fusion framework for solving multi-objective combinatorial optimization (MOCO). The authors introduce the concept of "image" for MOCO to better capture the spatial structure of problem instances, enhancing the learning process. They also propose a problem-size adaptive resolution strategy to improve generalization. Finally, the paper presents a multimodal fusion mechanism with modality-specific bottlenecks to efficiently integrate graph and image information.

优点

  1. The writing is good.

  2. The experiments are detailed, and the results are competitive.

缺点

  1. I believe the role of the image concept in CO is questionable. To some extent, using images in CO results in information loss and requires more space to represent. As far as I know, many Euclidean TSP models, like [1, 2], use positions directly as input, which requires less space and provides more precise information.

  2. Compared to typical neural MOCO methods, GIMF uses sparse matrix images as input, resulting in larger neural network sizes and an inability to handle larger-scale routing problems.

问题

  1. What's the training loss of the GIMF?

  2. Can GIMF obtain a Pareto set of solutions?

  3. I noticed the authors used multi-modal fusion, but I don't quite understand this part. Does it mean that each subproblem requires training a single model and then performing model fusion at the end?

AC 元评审

The paper proposes a graph-image multimodal fusion framework to enhance neural multi-objective combinatorial optimization. Contributions: constructing coordinate images, employing a problem-size adaptive resolution strategy, and introducing a multimodal fusion mechanism with modality-specific bottlenecks. Strengths: the experiments demonstrate consistent improvements over state-of-the-art method; novelty in integrating image-based information and detailed experimental validation. Weaknesses: marginal improvements reported in certain cases and the increased computational cost due to image processing; constructing images for some real-world problems might be challenging.

审稿人讨论附加意见

The responses addressed most concerns, leading to my acceptance recommendation based on the framework’s novel approach and experimental support.

最终决定

Accept (Poster)