Image and Video Processing
ChWDTA: Channel-wise Wavelet-Domain Transformer Attention and Entropy Modeling for Learned Image Compression
Haisheng Fu, Runyu Yang, Feng Ding et al. (+5 more)
State-of-the-art learned image compression (LIC) schemes are increasingly based on hybrid CNN-
transformer architectures. To further improve rate-distortion performance, we introduce channel-wise wavelet transforms into both the
transformer and
entropy-coding components. First, we propose a channel-wise wavelet-domain
transformer attention (ChWDTA) mechanism. ChWDTA keeps the efficient windowed spatial self-
attention used in modern LIC backbones, but computes the Q/K/V projections on channel-wise wavelet-transformed features before mapping the
attention output back with the inverse transform. The resulting Channel-wise Wavelet-Domain
Transformer Block (ChWDTB) therefore preserves the spatial tokenization pattern of windowed
attention while sparsifying the channel covariance seen by the
attention projections. Second, in the
entropy-coding stage, we introduce a channel-wise wavelet packet (ChWP) decomposition that produces four equal-sized subbands, which better fit channel-wise slice-based autoregressive
entropy modeling. When each channel-wise subband is divided into two slices, we use eight slices for
entropy coding. With this configuration, the proposed scheme obtains BD-rate reductions of -17.82%, -19.15%, and -22.56% on the Kodak, CLIC Professional Validation, and Tecnick test sets, respectively. Even when each channel-wise subband is coded as a single slice, the scheme still retains most of the coding gains with lower complexity. The results confirm the advantage of introducing wavelet transform in CNN-
transformer-based LIC schemes.
Read the full abstract ▾
All authors Haisheng Fu, Runyu Yang, Feng Ding, Siyu Zhu, Jie Liang, Xiaoxiao Li, Zhenman Fang, Jingning Han
Signal Processing
Project SPARROW and the Future of Conservation Technology
Juan M. Lavista Ferres, Carl Chalmers, Bruno Demuro Segundo et al. (+14 more)
Global biodiversity is declining at unprecedented rates, yet the tools available to monitor and protect ecosystems remain limited by constraints in power, connectivity, and accessibility. We present SPARROW, a hardware and software open-source platform that integrates
solar energy, edge artificial intelligence, and satellite communication to enable continuous, autonomous biodiversity monitoring in remote environments. Each SPARROW node combines a low-power Graphics Processing Unit (GPU) with modular visual, acoustic, and environmental sensors, performing on-device deep learning inference and transmitting summarized results through Low-Earth-Orbit (LEO) satellite or Global System for Mobile Communications (GSM) networks. We deployed SPARROW across tropical, temperate, and montane ecosystems in Colombia, Peru, Tanzania, and the United States, where it sustained 24/7 operation under variable environmental conditions and collected more than two million images and acoustic recordings in the first 190 days. The system demonstrated robust real-time classification and adaptive power management, achieving full autonomy without on-site human intervention. By integrating renewable energy, on-edge AI, and open-source design, SPARROW lowers the technical and financial barriers to ecological monitoring and establishes a scalable foundation for a distributed, intelligent network of sensors, an emerging "Internet of Living Things" for planetary biodiversity monitoring.
Read the full abstract ▾
All authors Juan M. Lavista Ferres, Carl Chalmers, Bruno Demuro Segundo, Zhongqi Miao, Andres Hernandez Celis, Federico Alves Torres, Isai Daniel Chacon Silva, Anthony Cintron Roman, Allen Kim, Meygha Machado, Luana Marotti, Amy Michaels, Daniela Ruiz Lopez, Catherine Romero, Rahul Dodhia, Inbal Becker-Reshef, Pablo Arbelaez
Signal Processing
PARAFAC-Based Time-Varying Channel Estimation for IRS-Aided Communications
Kenneth B. A. Benício, André L. F. de Almeida, Bruno Sokal et al. (+3 more)
This paper proposes a tensor-based parametric channel estimation technique for IRS-assisted communication systems with time-varying channel parameters. We exploit the multidimensional structure of the received signal by developing a $3$rd-order PARAFAC tensor model that is solved by employing the iteratively ALS
algorithm. Our simulation results show that the proposed approach provides enhanced performance in terms of NMSE of the concatenated channel compared to the competing solutions by capitalizing on the intrinsic tensor structure of the received signal without increasing the computational complexity of the channel estimation.
Read the full abstract ▾
All authors Kenneth B. A. Benício, André L. F. de Almeida, Bruno Sokal, Fazal-E-Asim, Behrooz Makki, Gabor Fodor
Signal Processing
Low-Complexity Tensor-Based Monostatic Sensing for IRS-Assisted Communication Systems
Kenneth B. A. Benício, Bruno Sokal, André L. F. de Almeida et al. (+3 more)
This paper proposes a tensor-based parameter estimation
algorithm for sensing in an intelligent reflecting surface-assisted system. We present a higher-order singular value decomposition-based solution that exploits the tensor structure of the received echo signal to jointly estimate the target's delay, Doppler, and angular information. Our tensor-based solution can estimate the parameters individually at low complexity, benefiting from parallel computation. Complexity analysis is carried out in comparison with a baseline scheme that does not exploit the intrinsic multilinear structure of the sensed signal. Simulation results show that our proposed tensor-based method can achieve the same performance as the reference method while drastically reducing the computational complexity.
Read the full abstract ▾
All authors Kenneth B. A. Benício, Bruno Sokal, André L. F. de Almeida, Fazal-E-Asim, Behrooz Makki, Gábor Fodor
Image and Video Processing
BCER Agent: Reliable Long-Horizon MRI Workflow Execution via Compilation, Artifact Binding, and Bounded Local Recovery
Ziyang Long, Xinqi Li, Junzhou Chen et al. (+3 more)
Many recent medical VLM and
agent studies are benchmarked on 2D images or comparatively short tool-calling exchanges, whereas real MRI analysis typically demands long, interdependent pipelines that operate on 3D/4D volumetric data. Under these conditions, reactive tool-calling
agents are prone to cascading breakdowns triggered by faulty intermediate references, mismatched tool arguments, and limited control over cross-step dependencies. To address this, we introduce BCER (
Brain-Cerebellum-Extremity-Reflector), a controller architecture aimed at dependable long-horizon MRI workflow execution. BCER decouples high-level planning from execution and provides bounded local recovery. We assess BCER on a multi-organ MRI
benchmark covering
brain, prostate, and cardiac tasks with both short- and long-chain workflows, using matched task contracts across controller variants and several backbone models. Relative to reactive baselines, BCER yields consistent improvements in end-to-end execution, with the most pronounced gains observed on long-chain workflows. BCER additionally enables auditability by maintaining explicit links between final outputs and intermediate artifacts and measurements. Code and
benchmark are released at https://github.com/Albertlongzi/BCER.
Read the full abstract ▾
All authors Ziyang Long, Xinqi Li, Junzhou Chen, Yifan Gao, Debiao Li, Hsin-Jung Yang
Systems and Control · Cross-listed from cs.RO
Learning and Adaptation in Wire Arc Additive Manufacturing Bead Geometry Control
Chen-Lung Lu and John Wen
Robotics Wire Arc Additive Manufacturing (WAAM) is governed by complex and nonlinear process dynamics coupling thermal field to the build geometry. The process may be regarded as a multi-input/multi-output dynamical system with welding torch speed and wire feed rate as inputs and weld bead deposition height and width as outputs. In this paper, we use the input/output data to learn a data-driven model and use it for weld planning and control. We show that a simple recurrent neural network architecture and one-step-ahead predictive control can improve the process performance in terms of height and width consistency. To account for the changing thermal conditions during the printing process, we update the learning model using prediction error from the previous layer. This adaptation step further improves the prediction accuracy and controller performance. Experiments on a robotic WAAM testbed with integrated line-scanner feedback significant improvements in height and width consistency compared to constant input and static model baselines. The proposed learning and adaptation framework provides a practical pathway toward robust, data-driven regulation of additive manufacturing processes.
Read the full abstract ▾
Systems and Control · Cross-listed from cs.RO
Multi-Resolution End-to-End Deep Neural Network for Optimizing Latency-Accuracy Tradeoff in Autonomous Driving
Qitao Weng and Heechul Yun
Latency-accuracy tradeoffs are fundamental in real-time applications of deep neural networks (DNNs) for cyber-physical systems. In autonomous driving, in particular, safety depends on both prediction quality and the end-to-end delay from sensing to actuation. We observe that (1) when latency is accounted for, the latency-optimal network configuration varies with scene context and compute availability; and (2) a single fixed-resolution model becomes suboptimal as conditions change. We present a multi-resolution, end-to-end deep neural network for the CARLA urban driving challenge using
monocular camera input. Our approach employs a convolutional neural network (CNN) that supports multiple input resolutions through per-resolution batch normalization, enabling runtime selection of an ideal input scale under a latency budget, as well as resolution retargeting, which allows multi-resolution training without access to the original training
dataset. We implement and evaluate our multi-resolution end-to-end CNN in CARLA to explore the latency-safety frontier. Results show consistent improvements in per-route safety metrics - lane invasions, red-light infractions, and collisions - relative to fixed-resolution baselines.
Read the full abstract ▾
Systems and Control
Energy-Optimal Thermal Management of Heat-Pump Battery Electric Vehicles
Prashant Lokur and Nikolce Murgovski
This paper presents an energy-optimal hybrid control framework for thermal management of heat-pump battery electric vehicles (BEVs). The controller coordinates the compressor, coolant pumps, and cabin blower across the coupled refrigerant, coolant, and air loops, while enforcing cabin comfort and component temperature constraints. The framework combines a rule-based supervisory layer, which handles discrete system configuration, with a continuous nonlinear model predictive control (NMPC) optimizer that minimizes thermal energy consumption over a finite prediction horizon. A control-oriented model is developed to capture the dominant dynamics of the cabin, refrigerant loop, reconfigurable coolant
circuits, and key thermal masses including the battery, motor, and inverter. The model is validated against a high-fidelity reference, achieving a mean absolute temperature prediction error below \SI{1.8}{\celsius} for key thermal states including the battery, motor, and cabin air temperature, while reducing simulation time by approximately \SI{85}{\percent}. The terminal cost is computed by linearizing the system about a quasi-steady operating point and solving the discrete-time algebraic Riccati equation, ensuring well-conditioned optimization across varying operating conditions. The proposed framework is evaluated against the built-in rule-based controller of MathWorks Simscape Electric Vehicle Thermal Management with Heat Pump model under cold-
climate extended driving conditions, demonstrating consistent reductions of \SI{20}{}-\SI{28}{\percent} in thermal energy consumption across all tested scenarios. The complete implementation, developed using the open-source CasADi framework, is made openly available at \href{https://github.com/PrashantLokur/ThermalEnergyManagementWithHybridControlFramework}{GitHub} repository to support reproducibility and further development.
Read the full abstract ▾
Signal Processing
Dimming Space-Time Code (DSTC) for Visible Light Communication with Semi-Blind Detection
Igor S. C. Rodrigues, Leandro R. Ximenes and André L. F. de Almeida
Visible light communication (VLC) provides a unified framework for wireless data transmission and illumination, but its practical deployment requires transmission schemes that jointly satisfy communication and lighting constraints. In color-shift keying (CSK) systems, dimming remains a challenging and underexplored problem because the average optical power must be controlled without altering the perceived chromaticity. This paper proposes a dimming space-time code (DSTC) for CSK-based VLC systems, where a structured dimming
matrix introduces controlled temporal power variations while satisfying physical feasibility, color preservation, and identifiability conditions. Two receiver architectures are developed: a pilot-assisted zero-forcing (ZF) receiver and a tensor-based semi-blind PARAFAC receiver that jointly estimates the channel and transmitted symbols using only one training time slot. Simulation results show that the proposed DSTC provides diversity gains and substantial BER reductions with respect to conventional CSK, while the tensor-based receiver improves spectral efficiency by reducing training overhead, with particular benefits in large-scale
MIMO configurations.
Read the full abstract ▾
Image and Video Processing
Accelerating HEVC Intra Partitioning via a CNN-Hierarchical Attention Transformer Hybrid
Krishna Kumar Sharma and Somdyuti Paul
The recursive quad-tree partitioning in High Efficiency
Video Coding (HEVC) incurs considerable computational overhead, with exhaustive rate-distortion optimization for CTU partition prediction consuming the dominant share of encoding time. Although partition prediction through deep learning has emerged as a viable encoding accelerator, an architectural dichotomy remains largely unaddressed: CNNs are computationally efficient but spatially myopic due to their localized effective receptive fields, failing to capture long range semantic relationships and repetitive textures; conversely,
transformer based architectures are better at capturing global context but incur prohibitive CPU latency, a critical liability that impedes deployment which is predominantly CPU-bound. This paper introduces Hybrid Fast
Vision Transformer (HFViT), a hybrid architecture designed to accelerate HEVC intra-mode partition prediction. HFViT fuses a reparameterized depthwise-separable convolutional backbone with a Hierarchical
Attention Transformer (HAT) mechanism, leveraging a carrier
token scheme to enable efficient global information propagation at sub-quadratic complexity. Post-training structural fusion collapses batch normalization into preceding layers to further reduce latency. Comprehensive evaluation reveals the efficacy of HFViT in accelerating HEVC intra-encoding across resolutions. On standard JCT-VC test sequences, HFViT reduces the average VMAF BD-rate penalty by 2.4, 2.6, and 7.9 percentage points on Classes A, B and E, respectively, as compared to the competing ETH-CNN baseline while maintaining CPU inference latency within 8% of the CNN baseline and surpassing it on GPU by 40%, establishing practical viability for real-time encoder integration.
Read the full abstract ▾
Systems and Control
Grid Capacity Expansion under Data Centers and Electrified Manufacturing Large Loads
Jiyong Lee, Melody Agustin, Joanne Langsdorf et al. (+3 more)
In this paper, we consider the expansion of power grids under emerging large loads from data centers and electrified manufacturing. We develop a multi-period grid capacity expansion model to determine optimal investment profiles for power generation, storage, and transmission capacity while accounting for hourly power dispatch, such that electricity demand is satisfied and the total planning and operation cost is minimized. We also propose a new modeling approach regarding the spatial distribution of demand from large loads. The model is used to analyze the expansion of a synthetic grid that follows key characteristics of the ERCOT system over a seven-year planning horizon, under loads from data centers and electrified oil refining, which account for 17.5% and 4.7% of total annual electricity demand by the end of the planning horizon. The optimal investment policy leads to an 83.6% increase in generation capacity and exploits the short construction times of
solar and storage as well as the operational flexibility of thermal generators. Finally, sensitivity analysis reveals that the construction time of grid assets substantially impacts investment timing, generation technology mix, and transmission capacity expansion. The proposed modeling framework is general and can be extended to other grid systems, enabling the exploration of diverse demand scenarios, policy assumptions, and regional characteristics.
Read the full abstract ▾
All authors Jiyong Lee, Melody Agustin, Joanne Langsdorf, Erhan Kutanoglu, Michael Baldea, Ilias Mitrai
Systems and Control
Local Observability and Moving Horizon Estimation-based Training of Feedforward Neural Networks
Yi Yang, Victor G. Lopez and Matthias A. Müller
In this paper, we propose a moving horizon estimation (MHE)-based training method for feedforward neural networks (FNNs) with rectified linear unit (ReLU) activation functions to determine their ideal weights from a control-theoretic perspective. This allows for a rigorous theoretical analysis of the trained network. First, we reformulate the FNN as a dynamical system with the weights as states. Then, we investigate the local observability of such a system. For two-layer FNNs with fixed output weights, we derive a sufficient condition under which the observability rank condition holds, ensuring a locally observable state. We also show that multi-layer FNNs in general fail to satisfy the observability rank condition. Based on this analysis, we develop a persistently exciting (PE) input design method, which renders a state distinguishable from its neighbors. The resulting local observability provides convergence guarantees for the proposed MHE-based training, where only the projection of the state onto the observable subspace is updated using a fixed-length window of input-output data. The effectiveness of the approach is illustrated via numerical examples.
Read the full abstract ▾
Systems and Control
Tensorized Radiative Heat Transfer for a Scalable and Calibrated Building Energy Simulator
Sang woo Ham, Donghun Kim, Michael Rossetti et al. (+1 more)
Accurate building energy simulation is essential for developing advanced control strategies that enable demand flexibility and grid responsiveness. The Smart Buildings Control Suite (sbsim) offers a lightweight, scalable, and data-calibrated simulation environment based on a tensorized finite difference model. Previous work extended sbsim to include interior long-wave radiative heat exchange between indoor surfaces. However, a complete thermal model must also account for exterior radiative processes, including long-wave radiation exchange with the sky and surroundings, as well as short-wave
solar radiation incident on building surfaces. This paper presents a comprehensive radiative heat transfer implementation for sbsim that integrates both interior and exterior radiation mechanisms. Our primary contribution is the development and integration of a fully tensorized exterior radiation module that captures sky and ground long-wave exchange as well as
solar heat gains through opaque and transparent surfaces. By formulating these processes as tensor operations compatible with the existing framework, we preserve the computational efficiency necessary for reinforcement learning applications. We validate our implementation against established simulation tools and demonstrate improved prediction accuracy for surface temperatures and building thermal loads. This enhancement significantly increases the physical fidelity of sbsim, enabling more realistic training environments for building energy optimization and control.
Read the full abstract ▾
All authors Sang woo Ham, Donghun Kim, Michael Rossetti, John Sipple
Image and Video Processing
FRAPPE: Full Input, Residual Output Autoencoding with Projection Pursuit Encoder
Dan Jacobellis and Neeraja J. Yadwadkar
Media compression standards have reached a plateau in terms of the rate-distortion-complexity trade-off, limiting the ability to offload expensive AI perception to the cloud in applications like robotics, wearables, and remote sensing. DNN-based codecs improve compression efficiency, but at a cost: they cannot easily adapt to large changes in available bitrate, and real-time encoding requires expensive, power-hungry GPUs that prohibit use on low-cost or resource-constrained platforms. To address these limitations, we propose a novel autoencoding framework (FRAPPE) that uses the Full input to predict the Residual output via a Projection Pursuit Encoder. FRAPPE's encoding objective naturally sorts latent channels by importance, allowing zero-overhead variable-rate coding. Unlike RNN-based learned codecs, whose encoder consumes the previous reconstruction's residual, or RVQ-style codecs, whose codebooks must be applied sequentially, FRAPPE's analysis path is an embarrassingly parallel DAG of independent input projections. Using FRAPPE, we build a variable-rate RGB image codec (FRAPPE-Image), and evaluate its rate-distortion-complexity trade-off against standard image codecs. At high compression ratios (approx. 0.1 bpp) FRAPPE-Image provides higher perceptual quality than AVIF with 47 times faster encoding, making it capable of real-time 1080p, 30fps CPU-only encoding. Our code and pre-trained models are available: https://github.com/UT-SysML/FRAPPE .
Read the full abstract ▾
Signal Processing · Cross-listed from math.OC
Manifold-based Algorithms for the Hadamard Decomposition
Nicolas Gillis, Subhayan Saha, Stefano Sicilia et al. (+1 more)
Given a
matrix $X$, and two ranks $r_1$ and $r_2$, the Hadamard decomposition (HD) looks for two low-rank
matrices, $X_1$ of rank $r_1$ and $X_2$ of rank $r_2$, both of the same size as $X$, such that $X\approx X_1\circ X_2$, where $\circ$ is the Hadamard (element-wise) product. In most cases, HD is more expressive than standard low-rank approximations such as the truncated singular value decomposition (TSVD), as it can represent higher-rank
matrices with the same number of parameters; this is because the rank of $X_1 \circ X_2$ is generically equal to $r_1 r_2$. In this paper, we first present some theoretical insights for HD, in particular a useful reformulation $X\approx WH^\top$ where $W$ and $H$ have $r_1 r_2$ columns and belong to certain
manifolds. These allow us to develop three new
algorithms for computing HD. The first one uses the representation $X\approx X_1\circ X_2$ and relies on the Manopt toolbox. The other two rely on the reformulation $X\approx WH^\top$: one is a block projected gradient method, and the other is a
manifold-based gradient descent
algorithm that does not require projection onto the feasible set. The last two
algorithms are particularly effective for handling large sparse data. We also propose new initializations that allow us to improve the accuracy of the HD. We compare our
algorithms and initialization strategies with the TSVD and with the state of the art. Numerical results show that the new methods are efficient and competitive on both synthetic and real data.
Read the full abstract ▾
All authors Nicolas Gillis, Subhayan Saha, Stefano Sicilia, Arnaud Vandaele
Systems and Control
Identifiability of Low Frequency Li-ion Battery Parameters in Time Domain
Vladimir Sovljanski and Mario Paolone
This paper investigates the identification of observable low-frequency (LF) parameters of battery
cell's equivalent
circuit models (ECMs) using time-domain voltage and current measurements sampled at low frequency by built-in battery management systems (BMS) during operation. Accurate estimation of such parameters is challenging due to measurement resolution available in practical settings. To address this, a modeling and identification framework is proposed in which fractional constant phase element (CPE), commonly used to model LF
diffusion phenomena of battery
cells, is approximated in the time domain using a high-order RC network with a recursive definition. The parameter estimation problem is formulated as a constrained, non-convex least-squares problem in a discretized state-space representation. To improve robustness, parameter initialization strategies, bounds, and a procedure for selecting the number of RC branches are rigorously derived. The method is evaluated in a numerical study based on a power system application where the battery under the study provides primary frequency control to the grid. Under noise levels representative of typical BMS measurements, the proposed approach achieves, from time-domain measurements, accurate LF parameter estimation (including the CPE), with average errors below 1 %.
Read the full abstract ▾