Systems and Control
Joint Trajectory, RIS, and Computation Offloading Optimization via Decentralized Model-Based PPO in Urban Multi-UAV Mobile Edge Computing
Liangshun Wu, Jianbo Du and Junsuo Qu
Efficient computation offloading in multi-
UAV edge networks becomes particularly challenging in dense urban areas, where line-of-sight (LoS) links are frequently blocked and user demand varies rapidly. Reconfigurable intelligent surfaces (RISs) can mitigate blockage by creating controllable reflected links, but realizing their potential requires tightly coupled decisions on
UAV trajectories, offloading schedules, and RIS phase configurations. This joint optimization is hard to solve in practice because multiple
UAVs must coordinate under limited information exchange, and purely model-free multi-
agent reinforcement learning (MARL) often learns too slowly in highly dynamic environments. To address these challenges, we propose a decentralized model-based MARL framework. Each
UAV optimizes mobility and offloading using observations from several hop neighbors, and submits an RIS phase proposal that is aggregated by a lightweight RIS controller. To boost sample efficiency and stability,
agents learn local dynamics models and perform short horizon branched rollouts for proximal policy optimization (PPO) updates. Simulations show near centralized performance with improved throughput and energy efficiency at scale.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
Patient-Level Multimodal Question Answering from Multi-Site Auscultation Recordings
Fan Wu, Tsai-Ning Wang, Nicolas Zumarraga et al. (+8 more)
Auscultation is a vital diagnostic tool, yet its utility is often limited by subjective interpretation. While general-purpose Audio-
Language Models (ALMs) excel in general domains, they struggle with the nuances of physiological signals. We propose a framework that aligns multi-site auscultation recordings directly with a frozen Large
Language Model (LLM)
embedding space via gated cross-
attention. By leveraging the LLM's latent world knowledge, our approach moves beyond isolated classification toward holistic, patient-level assessment. On the CaReSound
benchmark, our model achieves a state-of-the-art 0.865 F1-macro and 0.952 BERTScore. We demonstrate that lightweight, domain-specific encoders rival large-scale ALMs and that multi-site aggregation provides spatial redundancy that mitigates temporal truncation. This
alignment of medical acoustics with text foundations offers a scalable path for bridging signal processing and clinical assessment.
Read the full abstract ▾
All authors Fan Wu, Tsai-Ning Wang, Nicolas Zumarraga, Ning Wang, Markus Kreft, Kevin O'Sullivan, Elgar Fleisch, Oliver Aalami, Paul Schmiedmayer, Robert Jakob, Patrick Langer
Signal Processing
Edge-Side Fingerprints of Service Tiering and Quota Throttling in Starlink
Houtianfu Wang, Hanlin Cai, Haofan Dong et al. (+1 more)
We design and evaluate an edge-side measurement procedure for
auditing service tiering and quota-based throttling in Starlink. Using a 232.8-hour plan-hopping campaign on a UK residential terminal, we align 1 Hz terminal telemetry with host-side probes to obtain portal-labeled traces spanning priority, post-quota throttling, stay-active operation, and residential service. These regimes manifest as distinct signatures in goodput, PoP RTT, and an internal-to-user ratio \(R=C_{\mathrm{int}}/T_{\mathrm{user}}\). We further show that high-speed \(R\) is stable over 30-minute sub-windows, that low-rate clusters have no aligned persistent obstruction or PoP-loss signature, and that clean high-speed dips do not move \(R\) into the low-rate band. A lightweight rule on windowed medians separates high-speed from low-rate operation on this trace without operator visibility.
Read the full abstract ▾
All authors Houtianfu Wang, Hanlin Cai, Haofan Dong, Ozgur B. Akan
Audio and Speech Processing
Universal Speech Content Factorization
Henry Li Xinyuan, Zexin Cai, Lin Zhang et al. (+5 more)
We propose Universal
Speech Content Factorization (USCF), a simple and invertible linear method for extracting a low-rank
speech representation in which speaker timbre is suppressed while phonetic content is preserved. USCF extends
Speech Content Factorization, a closed-set voice conversion (VC) method, to an open-set setting by learning a universal
speech-to-content mapping via least-squares optimization and deriving speaker-specific transformations from only a few seconds of target
speech. We show through
embedding analysis that USCF effectively removes speaker-dependent variation. As a zero-shot VC system, USCF achieves competitive intelligibility, naturalness, and speaker similarity compared to methods that require substantially more target-speaker data or additional neural training. Finally, we demonstrate that as a training-efficient timbre-disentangled
speech feature, USCF features can serve as the acoustic representation for training timbre-prompted text-to-
speech models.
Speech samples and code are publicly available.
Read the full abstract ▾
All authors Henry Li Xinyuan, Zexin Cai, Lin Zhang, Leibny Paola García-Perera, Berrak Sisman, Sanjeev Khudanpur, Nicholas Andrews, Matthew Wiesner
Audio and Speech Processing · Cross-listed from cs.CV
Can You Hear, Localize, and Segment Continually? An Exemplar-Free Continual Learning Benchmark for Audio-Visual Segmentation
Siddeshwar Raghavan, Gautham Vinod, Bruce Coburn et al. (+1 more)
Audio-Visual
Segmentation (AVS) aims to produce pixel-level masks of sound producing objects in
videos, by jointly learning from audio and visual signals. However, real-world environments are inherently dynamic, causing audio and visual distributions to evolve over time, which challenge existing AVS systems that assume static training settings. To address this gap, we introduce the first exemplar-free continual learning
benchmark for Audio-Visual
Segmentation, comprising four learning protocols across single-source and multi-source AVS
datasets. We further propose a strong baseline, ATLAS, which uses audio-guided pre-fusion conditioning to modulate visual feature channels via projected audio context before cross-modal
attention. Finally, we mitigate catastrophic forgetting by introducing Low-Rank Anchoring (LRA), which stabilizes adapted weights based on loss sensitivity. Extensive experiments demonstrate competitive performance across diverse continual scenarios, establishing a foundation for lifelong audio-visual perception. Code is available at${}^{*}$\footnote{Paper under review} - \hyperlink{https://gitlab.com/viper-purdue/atlas}{https://gitlab.com/viper-purdue/atlas} \keywords{Continual Learning \and Audio-Visual
Segmentation \and Multi-Modal Learning}
Read the full abstract ▾
All authors Siddeshwar Raghavan, Gautham Vinod, Bruce Coburn, Fengqing Zhu
Systems and Control · Cross-listed from cs.AI
The FABRIC Strategy for Verifying Neural Feedback Systems
Samuel I. Akinwande, Sydney M. Katz, Mykel J. Kochenderfer et al. (+1 more)
Forward reachability analysis is a dominant approach for verifying reach-avoid specifications in neural feedback systems, i.e., dynamical systems controlled by neural networks, and a number of directions have been proposed and studied. In contrast, far less
attention has been given to backward reachability analysis for these systems, in part because of the limited scalability of known techniques. In this work, we begin to address this gap by introducing new
algorithms for computing both over- and underapproximations of backward reachable sets for nonlinear neural feedback systems. We also describe and implement an integration of these backward reachability techniques with existing ones for forward analysis. We call the resulting
algorithm Forward and Backward Reachability Integration for Certification (FaBRIC). We evaluate our
algorithms on a representative set of
benchmarks and show that they significantly outperform the prior state of the art.
Read the full abstract ▾
All authors Samuel I. Akinwande, Sydney M. Katz, Mykel J. Kochenderfer, Clark Barrett
Systems and Control · Cross-listed from cs.RO
Formation-Aware Adaptive Conformalized Perception for Safe Leader-Follower Multi-Robot Systems
Richie R. Suganda and Bin Hu
This paper considers the perception safety problem in distributed
vision-based leader-follower formations, where each
robot uses onboard perception to estimate relative states, track desired setpoints, and keep the leader within its camera field of view (FOV). Safety is challenging due to heteroscedastic perception errors and the coupling between formation maneuvers and visibility constraints. We propose a distributed, formation-aware adaptive conformal prediction method based on Risk-Aware Mondrian CP to produce formation-conditioned uncertainty
quantiles. The resulting bounds tighten in high-risk configurations (near FOV limits) and relax in safer regions. We integrate these bounds into a Formation-Aware Conformal CBF-QP with a smooth margin to enforce visibility while maintaining feasibility and tracking performance. Gazebo simulations show improved formation success rates and tracking accuracy over non-adaptive (global) CP baselines that ignore formation-dependent visibility risk, while preserving finite-sample probabilistic safety guarantees. The experimental
videos are available on the \href{https://nail-uh.github.io/iros2026.github.io/}{project website}\footnote{Project Website: https://nail-uh.github.io/iros2026.github.io/}.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
VoxEmo: Benchmarking Speech Emotion Recognition with Speech LLMs
Hezhao Zhang, Huang-Cheng Chou, Shrikanth Narayanan et al. (+1 more)
Speech Large
Language Models (LLMs) show great promise for
speech emotion recognition (SER) via generative interfaces. However, shifting from closed-set classification to open text generation introduces zero-shot stochasticity, making evaluation highly sensitive to
prompts. Additionally, conventional
speech LLMs
benchmarks overlook the inherent ambiguity of human
emotion. Hence, we present VoxEmo, a comprehensive SER
benchmark encompassing 35
emotion corpora across 15
languages for
Speech LLMs. VoxEmo provides a standardized toolkit featuring varying
prompt complexities, from direct classification to paralinguistic
reasoning. To reflect real-world perception/application, we introduce a distribution-aware soft-label protocol and a
prompt-ensemble strategy that emulates annotator disagreement. Experiments reveal that while zero-shot
speech LLMs trail supervised baselines in hard-label accuracy, they uniquely align with human subjective distributions.
Read the full abstract ▾
All authors Hezhao Zhang, Huang-Cheng Chou, Shrikanth Narayanan, Thomas Hain
Systems and Control · Cross-listed from cs.NI
Optimizing Reinforcement Learning Training over Digital Twin Enabled Multi-fidelity Networks
Hanzhi Yu, Hasan Farooq, Julien Forgeat et al. (+4 more)
In this paper, we investigate a novel digital network twin (DNT) assisted deep learning (DL) model training framework. In particular, we consider a physical network where a base station (BS) uses several
antennas to serve multiple mobile users, and a DNT that is a virtual representation of the physical network. The BS must adjust its
antenna tilt angles to optimize the data rates of all users. Due to user mobility, the BS may not be able to accurately track network dynamics such as wireless channels and user mobilities. Hence, a reinforcement learning (RL) approach is used to dynamically adjust the
antenna tilt angles. To train the RL, we can use data collected from the physical network and the DNT. The data collected from the physical network is more accurate but incurs more communication overhead compared to the data collected from the DNT. Therefore, it is necessary to determine the ratio of data collected from the physical network and the DNT to improve the training of the RL model. We formulate this problem as an optimization problem whose goal is to jointly optimize the tilt angle adjustment policy and the data collection strategy, aiming to maximize the data rates of all users while constraining the time delay introduced by collecting data from the physical network. To solve this problem, we propose a hierarchical RL framework that integrates robust
adversarial loss and proximal policy optimization (PPO). Simulation results show that our proposed method reduces the physical network data collection delay by up to 28.01% and 1x compared to a hierarchical RL that uses vanilla PPO as the first level RL, and the baseline that uses robust-RL at the first level and selects the data collection ratio randomly.
Read the full abstract ▾
All authors Hanzhi Yu, Hasan Farooq, Julien Forgeat, Shruti Bothe, Kristijonas Cyras, Md Moin Uddin Chowdhury, Mingzhe Chen
Systems and Control · Cross-listed from cs.IT
Feedback Does Not Increase the Capacity of Approximately Memoryless Surjective POST Channels
Xiaojing Zhang, Jun Chen and Guanghui Wang
We study a class of finite-state channels, known as POST channels, in which the previous channel output serves as the current state. A POST channel is deemed approximately memoryless when the state-dependent transition
matrices are sufficiently close to one another. For this family of channels, under a surjectivity condition on the associated memoryless reference channel, we show that the feedback capacity coincides with the non-feedback capacity. Consequently, for almost all approximately memoryless POST channels whose input alphabet size is no smaller than the output alphabet size, feedback provides no capacity gain. This result extends Shannon's classical
theorem on discrete memoryless channels and demonstrates that the phenomenon holds well beyond the strictly memoryless case.
Read the full abstract ▾
Signal Processing · Cross-listed from q-bio.NC
A Dynamical Systems and System Identification Framework for Phase Amplitude Coupling Analysis
Rajintha Gunawardena and Fei He
Phase-amplitude coupling (PAC), a form of cross-frequency coupling, is involved in diverse cognitive functions and neural communication, making its accurate detection and characterisation essential yet challenging. Most existing methods infer PAC from variations in instantaneous phase and amplitude profiles, but are limited by sensitivity to filter bandwidths, inconsistent performance across noise levels and data lengths, and vulnerability to spurious couplings. Here, we formulate PAC as a nonlinear dynamical-systems phenomenon characterised by quadratic phase coupling (QPC), and propose a nonlinear system identification framework that directly models the dynamics generating PAC. Rather than relying on filtered phase and amplitude fluctuations, the proposed method identifies a generative nonlinear model, enabling noise-free simulation of the estimated dynamics and model-based characterisation of coupling strength and preferred phase. It also provides dynamically grounded criteria for identifying harmonic- and intermodulation-related false detections, remains robust under high noise, and yields consistent characterisation despite changes in slow-frequency power. In simulations and rat hippocampal local field potentials (LFP) recordings, the proposed method produced more sharply localised and frequency-specific PAC estimates than
benchmark filtering-based methods, while preserving detailed preferred-phase information. In simulations, it rejected harmonic-related spurious coupling, remained robust at a signal-to-noise ratio (SNR) of 2 and reasonably robust at an SNR of 1, and reliably characterised PAC using 5-second analysis windows. These results establish nonlinear system identification as a complementary dynamical framework for detecting and characterising PAC, with particular advantages for noisy and short-duration neural recordings susceptible to spurious coupling.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.RO
SEP-NMPC: Safety Enhanced Passivity-Based Nonlinear Model Predictive Control for a UAV Slung Payload System
Seyedreza Rezaei, Junjie Kang, Amaldev Haridevan et al. (+1 more)
Model Predictive Control (MPC) is widely adopted for agile multirotor vehicles, yet achieving both stability and obstacle-free flight is particularly challenging when a payload is suspended beneath the airframe. This paper introduces a Safety Enhanced Passivity-Based Nonlinear MPC (SEP-NMPC) that provides formal guarantees of stability and safety for a quadrotor transporting a slung payload through cluttered environments. Stability is enforced by
embedding a strict passivity inequality, which is derived from a shaped energy storage function with adaptive damping, directly into the NMPC. This formulation dissipates excess energy and ensures asymptotic convergence despite payload swings. Safety is guaranteed through high-order control barrier functions (HOCBFs) that render user-defined clearance sets forward-invariant, obliging both the quadrotor and the swinging payload to maintain separation while interacting with static and dynamic obstacles. The optimization remains quadratic-program compatible and is solved online at each sampling time without gain scheduling or heuristic switching. Extensive simulations and real-world experiments confirm stable payload transport, collision-free trajectories, and real-time feasibility across all tested scenarios. The SEP-NMPC framework therefore unifies passivity-based closed-loop stability with HOCBF-based safety guarantees for
UAV slung-payload transportation.
Read the full abstract ▾
All authors Seyedreza Rezaei, Junjie Kang, Amaldev Haridevan, Jinjun Shan
Systems and Control · Cross-listed from cs.RO
Predictive Control with Indirect Adaptive Laws for Payload Transportation by Quadrupedal Robots
Leila Amanzadeh, Taizoon Chunawala, Randall T. Fawcett et al. (+2 more)
This paper formally develops a novel hierarchical planning and control framework for robust payload transportation by quadrupedal
robots, integrating a model predictive control (MPC)
algorithm with a gradient-descent-based adaptive updating law. At the framework's high level, an indirect adaptive law estimates the unknown parameters of the reduced-order (template) locomotion model under varying payloads. These estimated parameters feed into an MPC
algorithm for real-time trajectory planning, incorporating a convex stability criterion within the MPC constraints to ensure the stability of the template model's estimation error. The optimal reduced-order trajectories generated by the high-level adaptive MPC (AMPC) are then passed to a low-level nonlinear whole-body controller (WBC) for tracking. Extensive numerical investigations validate the framework's capabilities, showcasing the
robot's proficiency in transporting unmodeled, unknown static payloads up to 109% in experiments on flat terrains and 91% on rough experimental terrains. The
robot also successfully manages dynamic payloads with 73% of its mass on rough terrains. Performance comparisons with a normal MPC and an L1 MPC indicate a significant improvement. Furthermore, comprehensive hardware experiments conducted in indoor and outdoor environments confirm the method's efficacy on rough terrains despite uncertainties such as payload variations, push disturbances, and obstacles.
Read the full abstract ▾
All authors Leila Amanzadeh, Taizoon Chunawala, Randall T. Fawcett, Alexander Leonessa, Kaveh Akbari Hamed
Signal Processing · Cross-listed from cs.NI
Mobile Base Station Optimal Tour in Wide Area IoT Sensor Networks
Sachin Kadam
Wide-area IoT sensor networks require efficient data collection mechanisms when sensors are dispersed over large regions with limited communication infrastructure. Unmanned aerial vehicle (
UAV)-mounted Mobile Base Stations (MBSs) provide a flexible solution; however, their limited onboard energy and the strict energy budgets of sensors necessitate carefully optimized tour planning. In this paper, we introduce the Mobile Base Station Optimal Tour (MOT) problem, which seeks a minimum-cost, non-revisiting tour over a subset of candidate stops such that the union of their coverage regions ensures complete sensor data collection under a global sensor energy constraint. The tour also avoids restricted areas. We formally model the MOT problem as a combinatorial optimization problem, which is NP-hard. Owing to its computational intractability, we develop a
polynomial-time greedy heuristic that considers minimizing MBS travel cost covering all IoT sensors while avoiding restricted areas. Using simulations, we obtain tours with low cost, complete sensor coverage, and faster execution. The proposed framework provides both theoretical insight into the structural complexity of MBS-assisted data collection and a practical algorithmic solution for large-scale IoT deployments.
Read the full abstract ▾
Systems and Control
Neural Network Tuning of FSMPC for Drives
Juana M. Martínez-Heredia and José L. Mora
This preprint presents a neural network tuner for the finite state model predictive control of an induction motor. The tuner deals with the parameters of the controllers in the speed loop and in the stator current loop. The results are assessed using a five phase machine in an experimental setup. Data for the neural network training is obtained from the experiments using step tests.
Read the full abstract ▾
Audio and Speech Processing · Cross-listed from cs.SD
Benchmarking Language Modeling for Lossless Compression of Full-Fidelity Audio
Phillip Long, Zachary Novack and Chris Donahue
Autoregressive "
language" models (LMs) trained on raw waveforms can be repurposed for lossless audio compression, but prior work is limited to 8-bit audio, leaving open whether such approaches work for practical settings (16/24-bit) and can compete with existing codecs. We
benchmark LM-based compression on full-fidelity audio across diverse domains (music,
speech, bioacoustics), sampling rates (16kHz-48kHz), and bit depths (8, 16, 24-bit). Standard sample-level tokenization becomes intractable at higher bit depths due to vocabulary size (65K for 16-bit; 16.7M for 24-bit). We propose Trilobyte, a byte-level tokenization schema for full resolution audio, improving vocabulary scaling from $O(2^{b})$ to $O(1)$ and enabling the first tractable 24-bit LM-based lossless compression. While LMs consistently outperform FLAC and yield state-of-the-art compression at 8-bit and 16-bit, we observe that compression gains become more modest as bit depth increases beyond 8-bit.
Read the full abstract ▾
Systems and Control
Carbon-aware Market Participation for Building Energy Management Systems
Young-ho Cho, Mohamad Chehade, Fatima Al-Janahi et al. (+3 more)
Tackling
climate change requires the rapid and deep decarbonization of electric power systems. While energy management systems (EMSs) play a central role in this transition, conventional EMSs focus mainly on economic efficiency and often overlook the environmental impact of operational decisions. To address this gap, this paper proposes a unified, real-time building-level carbon-aware EMS (CAEMS) capable of simultaneously co-optimizing grid imports, energy storage, and flexible demand within a single integrated framework. We formulate a mixed-integer linear program (MILP) model that directly integrates time-varying marginal carbon intensity signals into the EMS objective for coordinated participation in both day-ahead (DA) and real-time (RT)
markets. To relax the unrealistic assumption of perfect foresight, we incorporate a model predictive control (MPC) extension driven by a
Transformer-based forecaster that jointly predicts electricity prices and carbon intensity. The proposed CAEMS is validated using real-world data from the PJM electricity
market. Simulation results demonstrate that modest carbon prices can achieve a significant 22.5% reduction in emissions with only a 1.7% increase in cost.
Read the full abstract ▾
All authors Young-ho Cho, Mohamad Chehade, Fatima Al-Janahi, Sol Lim, Javad Mohammadi, Hao Zhu
Systems and Control
Reachability-based Temporal Logic Verification for Reliable LLM-guided Human-Autonomy Teaming
Joonwon Choi, Kartik Anand Pant, Karthik Nune et al. (+1 more)
We propose a reachability-based framework for reliable LLM-guided human-autonomy teaming (HAT) using signal temporal logic (STL). In the proposed framework, LLM is leveraged as a translator that transfers natural
language commands given by a human operator into corresponding STL specifications or vice versa. An STL feasibility filter (SFF) is proposed to check the feasibility of the generated STL. The SFF first decomposes the complex and nested LLM translation into a set of simpler subformulas for parallelization and informative feedback generation. The reachability analysis method is then applied to verify if each subformula is feasible for a target dynamical system: if feasible, perform mission planning, otherwise, reject it. The proposed SFF can identify infeasible subformulas, more than simply providing the boolean verification results for the whole STL, thereby facilitating the feedback generation of LLM to request modification of the command to the human. Consequently, the proposed framework can allow more reliable HAT by enabling safe and informative communication between the human operator and the autonomous
agent. Our experiments demonstrate that the proposed framework can successfully filter out infeasible subformulas and generate informative feedback based on such information.
Read the full abstract ▾
All authors Joonwon Choi, Kartik Anand Pant, Karthik Nune, Inseok Hwang
Signal Processing
On the SNR Statistics in Coupled-Core Multi-Core Fiber Transmissions with Mode-Dependent Loss
Chiara Lasagni, Paolo Serena, Alberto Bononi et al. (+4 more)
We investigate the impact of mode-dependent loss (MDL) on the statistics of the signal-to-noise ratio (SNR) in coupled-core multi-core fiber (CC-MCF) systems. Through numerical and theoretical simulations, we present an in-depth analysis of the impact of MDL on received amplified spontaneous emission (ASE) noise and nonlinear interference (NLI), as well as their joint contribution to the SNR. We show that MDL induces different statistics on the two noises and discuss the differences with single-mode polarization-dependent loss. Moreover, we investigate the impact of spatial mode dispersion (SMD) on the MDL-induced impairment, offering insights on their joint effects on ASE and NLI.
Read the full abstract ▾
All authors Chiara Lasagni, Paolo Serena, Alberto Bononi, Lucas A. Zischler, Giammarco Di Sciullo, Antonio Mecozzi, Cristian Antonelli
Systems and Control · Cross-listed from math.OC
Rethinking Strict Dissipativity for Economic MPC
Mario Zanon
Stability of economic model predictive control can be proven under the assumption that a strict dissipativity condition holds. This assumption has a clear interpretation in terms of the so-called rotated stage cost, which must have its minimum at the optimal steady state. However, contrary to dissipativity, for strict dissipativity the storage function cannot be immediately related to the value function of an optimal control problem formulated with the economic stage cost. We propose the novel concept of two-storage strict dissipativity, which requires two storage functions to satisfy dissipativity and be separated by a positive definite function. This new condition can be immediately related to optimal control by means of value functions and might be easier to verify than strict dissipativity. Furthermore, we prove that two-storage strict dissipativity is sufficient and necessary for asymptotic stability, it is related to strict dissipativity, and also to alternative approaches relying on the so-called cost-to-travel. Finally, we discuss commonly used and new terminal cost designs that guarantee asymptotic stability in the finite-horizon case.
Read the full abstract ▾
Image and Video Processing · Cross-listed from cs.CV
OccTrack360: 4D Panoptic Occupancy Tracking from Surround-View Fisheye Cameras
Yongzhi Lin, Kai Luo, Yuanfan Zheng et al. (+4 more)
Understanding dynamic 3D environments in a spatially continuous and temporally consistent manner is fundamental for robotics and autonomous driving. While recent advances in occupancy prediction provide a unified representation of scene geometry and semantics, progress in 4D panoptic occupancy tracking remains limited by the lack of
benchmarks that support surround-view fisheye sensing, long temporal sequences, and instance-level voxel tracking. To address this gap, we present OccTrack360, a new
benchmark for 4D panoptic occupancy tracking from surround-view fisheye cameras. OccTrack360 provides substantially longer and more diverse sequences (174~2234 frames) than prior
benchmarks, together with principled voxel visibility annotations, including an all-direction occlusion mask and an MEI-based fisheye field-of-view mask. To establish a strong fisheye-oriented baseline, we further propose Focus on Sphere Occ (FoSOcc), a framework that addresses two core challenges in fisheye occupancy tracking: distorted spherical projection and inaccurate voxel-space localization. FoSOcc includes a Center Focusing Module (CFM) to enhance instance-aware spatial localization through supervised focus guidance, and a Fisheye-based Enhanced Lifting (FEL) that extends perspective lifting to fisheye imaging under the Unified Projection Model. Extensive experiments on Occ3D-Waymo and OccTrack360 show that our method improves occupancy tracking quality with notable gains on geometrically regular categories, and establishes a strong baseline for future research on surround-view fisheye 4D occupancy tracking. The
benchmark and source code will be made publicly available at https://github.com/YouthZest-Lin/OccTrack360.
Read the full abstract ▾
All authors Yongzhi Lin, Kai Luo, Yuanfan Zheng, Hao Shi, Mengfei Duan, Yang Liu, Kailun Yang
Image and Video Processing · Cross-listed from cs.CV
Spherical-GOF: Geometry-Aware Panoramic Gaussian Opacity Fields for 3D Scene Reconstruction
Zhe Yang, Guoqiang Zhao, Sheng Wu et al. (+2 more)
Omnidirectional images are increasingly used in robotics and
vision due to their wide field of view. However, extending 3D Gaussian Splatting (3DGS) to panoramic camera models remains challenging, as existing formulations are designed for perspective projections and naive adaptations often introduce distortion and
geometric inconsistencies. We present Spherical-GOF, an omnidirectional Gaussian rendering framework built upon Gaussian Opacity Fields (GOF). Unlike projection-based rasterization, Spherical-GOF performs GOF ray sampling directly on the unit sphere in spherical ray space, enabling consistent ray-Gaussian interactions for panoramic rendering. To make the spherical ray casting efficient and robust, we derive a conservative spherical bounding rule for fast ray-Gaussian culling and introduce a spherical filtering scheme that adapts Gaussian footprints to distortion-varying panoramic pixel sampling. Extensive experiments on standard panoramic
benchmarks (OmniBlender and OmniPhotos) demonstrate competitive photometric quality and substantially improved
geometric consistency. Compared with the strongest baseline, Spherical-GOF reduces depth reprojection error by 57% and improves cycle inlier ratio by 21%. Qualitative results show cleaner depth and more coherent normal maps, with strong robustness to global panorama rotations. We further validate generalization on OmniRob, a real-world robotic omnidirectional
dataset introduced in this work, featuring
UAV and quadruped platforms. The source code and the OmniRob
dataset will be released at https://github.com/1170632760/Spherical-GOF.
Read the full abstract ▾
All authors Zhe Yang, Guoqiang Zhao, Sheng Wu, Kai Luo, Kailun Yang
Systems and Control
Input Dexterity and Output Negotiation in Feedback-Linearizable Nonlinear Systems
Mirko Mizzoni, Pieter van Goor, Barbara Bazzana et al. (+1 more)
We introduce a task-relative taxonomy of actuator inputs for nonlinear systems within the input-output feedback-linearization framework. Given a flat output specifying the task, inputs are classified as essential, redundant, or dexterity: essential inputs are required for exact linearization, redundant inputs can be removed without effect, and dexterity inputs can be deactivated while preserving exact linearization of a reduced task. We show that a subset is dexterity if and only if, under a suitable dynamic prolongation, it can appear as additional output channels (flat-input complement) on a common validity set. Whenever a family of systems obtained by (de)activating dexterity inputs admits a common prolongation, the family can be interpreted as a single prolonged system endowed with different output selections. This enables a unified linearizing controller that negotiates between full and reduced tasks without transients on shared outputs under compatibility and dwell-time conditions. Simulations on a fully actuated aerial platform illustrate graceful task downgrades from six-dimensional pose tracking as lateral-force channels are deactivated.
Read the full abstract ▾
All authors Mirko Mizzoni, Pieter van Goor, Barbara Bazzana, Antonio Franchi