PaperHub
7.8
/10
Poster4 位审稿人
最低4最高5标准差0.4
5
4
5
5
3.3
置信度
创新性2.8
质量3.3
清晰度3.3
重要性3.0
NeurIPS 2025

Non-monotone Submodular Optimization: $p$-Matchoid Constraints and Fully Dynamic Setting

OpenReviewPDF
提交: 2025-05-12更新: 2025-10-29

摘要

Submodular maximization subject to a $p$-matchoid constraint has various applications in machine learning, particularly in tasks such as feature selection, video and text summarization, movie recommendation, graph-based learning, and constraint-based optimization. We study this problem in the dynamic setting, where a sequence of insertions and deletions of elements to a $p$-matchoid $\mathcal{M}(\mathcal{V},\mathcal{I})$ occurs over time and the goal is to efficiently maintain an approximate solution. We propose a dynamic algorithm for non-monotone submodular maximization under a $p$-matchoid constraint. For a $p$-matchoid $\mathcal{M}(\mathcal{V},\mathcal{I})$ of rank $k$, defined by a collection of $m$ matroids, our algorithm guarantees a $(2p + 2\sqrt{p(p+1)} + 1 + \epsilon)$-approximate solution at any time $t$ in the update sequence, with an expected amortized query complexity of $O(\epsilon^{-3} pk^4 \log^2(k))$ per update.
关键词
optimizationsubmodularp-matchoidnon-monotonedynamic

评审与讨论

审稿意见
5

This paper presents the first dynamic algorithm for non-monotone submodular maximization under general p-matchoid constraints. The authors develop a recursive filtering and sampling framework that maintains an approximate solution as elements are inserted or deleted. Their algorithm achieves a provable approximation guarantee and low amortized query complexity, improving prior results for special cases like cardinality constraints.

优缺点分析

Strengths:

1.The paper introduces the first dynamic algorithm for non-monotone submodular maximization under general p-matchoid constraints, achieving strong theoretical guarantees and improving upon prior results.

2.The recursive filtering and sampling framework is elegant and efficiently handles both insertions and deletions with provable amortized query complexity.

Weaknesses:

1.The theoretical query complexity includes high-degree polynomial terms, which may limit scalability in real-world applications.

2.The dynamic model is based on the oblivious adversarial assumption, and its robustness against adaptive attack scenarios has not been fully discussed.

问题

  1. The algorithm relies on random sampling to simulate monotone behavior, how sensitive is the performance to the sampling probability q?
  2. Would a different choice affect approximation or update cost significantly?

局限性

Yes

最终评判理由

My concerns have been fully addressed via author rebuttal.

格式问题

N/A

作者回复

Thank you for the constructive and encouraging review. We greatly appreciate your positive assessment of the strength and elegance of our algorithm. Below, we address questions and concerns you raised.

The theoretical query complexity includes high-degree polynomial terms ...

We note that the query complexity, although polynomial in kk, is independent of nn, the size of the ground set. This makes it practical in many real-world scenarios.

The dynamic model is based on the oblivious adversarial assumption, and its robustness against adaptive attack scenarios has not been fully discussed.

The approximation guarantee of the algorithm does not rely on the oblivious adversarial assumption. However, our current analysis of the query complexity bounds is tailored to the oblivious setting and may not directly extend to scenarios against an adversary with full knowledge of the random bits used in the algorithm. However, we should note that this is a valid assumption in many real-world scenarios, and it is also consistent with prior work in fully dynamic submodular optimization, where, to the best of our knowledge, all existing results assume the same kind of adversarial setting. Nonetheless, robustness against adaptive adversaries is an interesting and important direction for future research in the field. 

The algorithm relies on random sampling to simulate monotone behavior. How sensitive is the performance to the sampling probability q?

The analysis of the algorithm is based on a fixed value for the parameter q=(p+p2+p+1)1q = (p+\sqrt{p^2+p}+1)^{-1}. We use equalities 1q1=(1+c)p\frac{1}{q} - 1 = (1 + c)p and 1q=1c1 - q = \frac{1}{c} to get an approximation gurantee of c(1+c)2p(1cϵ)\frac{c}{(1+c)^2p}\left(\frac{1}{c} - \epsilon \right). These equalities hold for the said choice of qq and c=1+1pc=\sqrt{1+\frac{1}{p}}.

We will clarify this earlier in the paper to avoid ambiguity.

If you feel that our response has adequately addressed your concerns, we would appreciate it if you would possibly raise your score accordingly.

评论

Dear Reviewer,

We would like to kindly check whether you have any remaining questions or concerns. We would be happy to provide further clarification. If not, we would be grateful if you could consider updating your score in light of the rebuttal.

评论

The authors fully addressed my concerns. I'm glad to raise my rating.

审稿意见
4

This paper investigates non-monotone submodular maximization in a fully dynamic setting with pp-matchoid constraints. The main contributions are:

  • A (2p+2p(p+1)+1+ϵ)(2p+2\sqrt{p(p+1)}+1+\epsilon)-approximation algorithm with an expected amortized query complexity of O(ϵ3pk4log2(k))O(\epsilon^{-3}pk^4\log^2(k)). This is the first theoretical advancement for this problem under pp-matchoid constraints.
  • As a byproduct, a (5.82+ϵ)(5.82+\epsilon)-approximation algorithm is proposed under size constraints with O(ϵ3k4log2(k))O(\epsilon^{-3}k^4\log^2(k)) oracle queries per update. This algorithm improves the best-known (8+ϵ)(8+\epsilon) approximation ratio for this problem.

优缺点分析

Strengths

  • The study addresses an important and practically relevant problem in submodular optimization, with clearly motivated applications discussed such as feature selection.
  • The paper provides the first approximation algorithm for non-monotone submodular maximization under pp-matchoid constraints in dynamic settings. As a by-product, it also improves the approximation ratio for the special case of cardinality constraints, advancing the state of the art.
  • The paper is clearly written and logically structured, making the technical contributions accessible to readers.

Weaknesses

Given the practical nature of dynamic settings, experimental validation on real-world or synthetic datasets would strengthen the paper’s impact.

问题

  • Empirical validation would significantly strengthen the paper's contributions. Especially the comparison of the (5.82+ϵ)(5.82+\epsilon)-approximation algorithm with the existing (8+ϵ)(8+\epsilon)-approximation algorithm under size constraints. Experiments under pp-matchoid can also serve as reference points for future works.
  • It might to better to shorten the first three sections and move some of the analysis into the analysis section.

局限性

Yes

最终评判理由

I have read the rebuttal and other reviews. I will keep my score.

格式问题

No

作者回复

We thank the reviewer for the positive evaluation and for highlighting the importance and quality of our contributions. We are very pleased that you found our paper well-written and technically solid.

We appreciate your helpful feedback and will incorporate your suggestions into our paper.

Specifically, regarding empirical evaluations, while the primary focus of this work has been on the theoretical development, we fully agree that empirical evaluations would further enhance the impact of our work. For the special case of cardinality constraints, we have conducted experiments on real-world datasets (videos from YouTube and Open Video Project for the task of video summarization). We compared our algorithm’s query complexity and submodular value against the state-of-the-art (8+ϵ)(8+\epsilon)-approximation algorithm, and the results showcased the competitive performance of our algorithm. We will include these in the revised version of our paper.

审稿意见
5

The paper studies dynamic maximization of submodular objective over a matchoid where single elements are inserted or removed dynamically. A 2-part algorithm is given; it builds an initial solution, and updates it as the ground set is modified. The paper includes its theoretical analysis, with findings pertaining to the query complexity and online approximation guarantees.

优缺点分析

The paper is written clearly. The concepts and settings are explained in a way that accommodates unfamiliar readers. The method is explained well, and adequately contextualized by existing work.

The contribution is significant due to the breadth of the considered setting. General submodular functions are relevant to machine learning, and matchoids capture a wide range of independence systems. The proposed method also improves over an existing method under a simpler setting in approximation guarantees, at the cost of increased query complexity.

Due to the generality of the setting, sharpened results in popular special cases would be appreciated. Only one case is listed. There is a large body of work on monotone objectives. I believe the approximation bound in this work can be strengthened under monotonicity of ff.

The algorithm contains some stochastic components, the most impactful of which is the RateSampling subroutine. It'd make the paper more self-contained to have its relevant probabilistic properties stated in Section 4.1.

The study lacks empirical investigation. It'd be nice to see the online approximation quality of the algorithm under various insertion/deletion patterns, or at least a direct comparison to the performances given by Banihashem et. al, 2023.

问题

Since ff can be non-monotone, the assertion that minXIf(X)=0\min_{X\in\mathcal{I}}f(X)=0 would preserve the generality of the problem, while f()=0f(\emptyset)=0 would not. Do the results in this work require that the latter hold, or would a more careful application of notations suffice?

Algorithm 1: is A0A_0 assigned 0 or \emptyset?

局限性

yes

最终评判理由

The authors adequately addressed my concerns, which are minor. Given that the additional experimental results are unavailable at this time, I will keep my score.

格式问题

N/A

作者回复

Thank you so much for your positive feedback. We are glad you were satisfied with the clarity, significance, and quality of our paper. We address specific questions and comments below:

Since ff can be non-monotone, the assertion ... . Do the results in this work require that the latter hold, or would a more careful application of notations suffice?

Thank you for the question. The stronger assumption is not required, and non-negativity of the function ff is sufficient for the analysis to hold, which, as you noted, preserves the generality of the problem. We have made proper adjustments to the notations accordingly.

Algorithm 1: is A0A_0 assigned 0 or \emptyset?

The variable A0A_0 is initialized to \emptyset. Thanks for catching this.

It'd be nice to see the online approximation quality of the algorithm under various insertion/deletion patterns, or at least a direct comparison to the performances given by Banihashem et. al, 2023.

We acknowledge that empirical results would provide further valuable insight. We have conducted experiments evaluating the performance of our algorithm for video summarization using datasets obtained from YouTube and the Open Video Project. For the special case of cardinality constraint, we benchmarked the total number of query calls and the submodular value of our solution, demonstrating competitive performance compared to [Banihashem et al., 2023]. As per the guidelines, we are unable to provide these during the rebuttal period; however, we will incorporate them in the final version of the paper.

评论

Thanks for addressing the questions. The setting for additional experimentation seems adequate, although I can't judge the results' merits. I will keep my score.

审稿意见
5

This paper studies non-monotone submodular maximization with p-matchoid constraint, in the fully dynamic setting. In such setting, elements are inserted and deleted by an adversary, and the goal is to maintain an high-quality solution using few queries. Typically, the amortized number of queries should not depend polynomially in nn, the length of the stream.

The authors propose an 4p\approx 4p approximation for pp-matchoids, building on the fully-dynamic framework of Banihashem et al.

优缺点分析

  • Submodular maximization is an important optimization task that has been studied intensively by the NeurIPS and ICML communities
  • The fully dynamic setting is well motivated in practice
  • Non-monotone submodular maximization naturally arises in applications
  • p-matchoids are arguably the most general constraints in the submodular maximization literature
  • the paper is fairly well written
  • the authors improve on the state of the art for cardinality constraints (from 8 to 5.82, but at the cost of worse running time)
  • The technical contribution is non-trivial, but not totally unexpected and original. The author's construction is heavily inspired by the versatile framework of Banihashem et al. and adapted to pp-matchoids.

问题

None

局限性

nothing to add here

最终评判理由

I confirm my score

格式问题

nothing to add here

作者回复

We thank the reviewer for recognizing the importance of our problem and contributions. We are pleased that you found the paper well-written and of high quality, and we greatly appreciate the positive and affirming review.

最终决定

This paper studies submodular maximization in the dynamic setting. The main result is an algorithm that maintains an approximate solution with a fast update time for non-monotone submodular maximization over a p-matchoid constraint. Previous dynamic algorithms were either for non-monotone functions under a cardinality constraint or for monotone functions under a matroid constraint. p-matchoid constraints are a general family of constraints that generalize matroids. This paper achieves a strong result for a very general setting. The algorithm is technically involved and interesting (but does mostly build on ideas from previous work).