AI & ML
TROPT: An Open Framework for Unifying and Advancing Discrete Text Optimization
arXiv cs.CR0 views
arXiv:2606.23496v2 Announce Type: replace-cross Abstract: Discrete text-trigger optimization -- searching for text sequences that, when ingested by a model, steer it toward a specified objective -- underpins model red-teaming (e.g., LLM jailbreaks), as well as auditing and interpretability. However, the current state of discrete optimizers hinders their adoption and progress. First, existing optimizers, when open-sourced at all, are scattered across research codebases tied to specific models, objectives, and problem domains. Second, optimizers proliferate, each requiring engineering overhead to use or extend, and remaining hard to compare head-to-head. Together, these raise the bar for adopting optimizers in existing or new domains, and for advancing them via new strategies. We address these gaps with TROPT, the first open-source framework that unifies discrete optimizers' execution and standardizes their development under a single interface. TROPT makes it easy to customize end-to-end optimization recipes by swapping any component -- models, objectives, and optimizers -- extending its reach across domains and new applications. TROPT currently ships with 40+ optimization recipes -- covering applications such as jailbreaking and probing model internals -- built from 15+ optimizers (spanning white-box to black-box access) and 15+ losses, from foundational to state-of-the-art methods. Demonstrating its utility, we leverage TROPT in several studies: (i) controlled, large-scale experiments comparing and enhancing optimization strategies for LLM jailbreaks, revealing potent-yet-underadopted techniques; and (ii) porting optimizers across applications and domains (e.g., from LLM jailbreaks to corpus poisoning). In all, TROPT significantly lowers the barrier to adopting and advancing discrete text optimization.
Source:https://arxiv.org/abs/2606.23496PreviousLeveraging Soft Prompts for Privacy Attacks in Federated Prompt TuningNextPrediction-Intervention Games and Invariant Sets
Related posts
FedCSGA: Evolutionary Client Selection with Joint Statistical and System Heterogeneity in Federated Learning
0arXiv cs.DC
Using profiles of cognitive capability to assess AI suitability for workplace tasks
0arXiv cs.HC
Metamaterial tactile displays with programmable virtual pixels
0arXiv cs.HC
MAIA: Multi-Agent Intent Articulation for Requirement Discovery in Art Commissions
0arXiv cs.HC
Patients With Personality: Realistic Patient Simulation through Controlled Diversity and Selective Disclosure
0arXiv cs.HC
Rethinking the UI of GenUI: A Tale of Two Designs
0arXiv cs.HC