DA: towards distribution adaptive test-time adaptation in dynamic wild world
Received date: 2024-12-19
Revised date: 2025-06-09
Accepted date: 2025-06-25
Online published: 2026-05-12
Test-time adaptation (TTA) has demonstrated effectiveness in addressing distribution shifts between training and testing data by adjusting a given model on test samples. However, when faced with testing data that exhibit dynamic patterns, wherein a single test sample batch is drawn from various distribution, the traditional TTA methods, which typically follow a fixed pattern of estimating batch normalization (BN) statistics and then performing back-propagation, tend to experience performance degradation. The key reasons we observed are as follows: (i) different scenarios require different normalization approaches (such as instance normalization (IN) is optimal in mixture domains, but not for static domains) and (ii) back-propagation could potentially degrade the model and waste time. Based on these observations, in this paper, we introduce a novel one-size-fits-all approach, named distribution adaptive test-time adaptation (DA). DA is designed to adaptively select the appropriate batch normalization method and back-propagation approach. It utilizes an IN–based projection method to differentiate between various scenarios. Our method allows the model to achieve a more robust representation, enabling it to adapt effectively to both static and dynamic data patterns. Furthermore, our method avoids unnecessary or potentially harmful backward passes, paving the way for further enhancements. The results show that our method demonstrates robustness while maintaining good performance of the model. It can effectively respond to data stream patterns, and the selective back-propagation approach is more lightweight.
Zhendong Liu , Jiarong Liao , Chuyang Ye , Dongyan Wei , Tingting Zhang , Xianghua Fu , Jingyan Jiang . DA: towards distribution adaptive test-time adaptation in dynamic wild world[J]. Moore and More, 2026 , 2(1) : 25 -36 . DOI: 10.1007/s44275-025-00035-2
| [1] | Quionero-Candela J , Sugiyama M , Schwaighofer A , Lawrence ND (2009) Dataset shift in machine learning. https://?doi.?org/?10.?7551/?mitpr?ess/?97802?62170?055.?001.?0001 |
| [2] | Hendrycks D , Dietterich T (2019) Benchmarking neural network robustness to common corruptions and perturbations. https://?doi.?org/?10.?48550/?arXiv.?1903.?12261 |
| [3] | Recht B , Roelofs R , Schmidt L , Shankar V (2019) Do ImageNet classifiers generalize to ImageNet? In: Proceedings of the 36th International Conference on Machine Learning, PMLR. IEEE, New York, pp 5389-5400. https://?doi.?org/?10.?48550/?arXiv.?1902.?10811 |
| [4] | Wang D , Shelhamer E , Liu S , Olshausen B , Darrell T (2021) Tent: fully test-time adaptation by entropy minimization. https://?doi.?org/?10.?48550/?arXiv.?2006.?10726 |
| [5] | Wang Q , Fink O , Van Gool L , Dai D (2022) Continual test-time domain adaptation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 7191-7201. https://?doi.?org/?10.?48550/?arXiv.?2203.?13591 |
| [6] | Gong T , Jeong J , Kim T , Kim Y , Shin J , Lee SJ (2023) NOTE: robust continual test-time adaptation against temporal correlation. In: Proceedings of the 36th International Conference on Neural Information Processing Systems (NIPS '22). Curran Associates Inc., Red Hook, NY, pp 27253-27266. https://?doi.?org/?10.?48550/?arXiv.?2208.?05117 |
| [7] | Yuan L , Xie B , Li S (2023) Robust test-time adaptation in dynamic scenarios. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 15922-15932. https://?doi.?org/?10.?1109/?CVPR5?2729.?2023.?01528 |
| [8] | Ioffe S , Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd International Conference on International Conference on Machine Learning-Volume 37 (ICML '15). JMLR.org, pp 448-456. https://?doi.?org/?10.?48550/?arXiv.?1502.?03167 |
| [9] | Wang W , Zhong Z , Wang W , Chen X , Ling C , Wang B et al (2023) Dynamically instance-guided adaptation: a backward-free approach for test-time domain adaptive semantic segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE, pp 24090-24099. https://?doi.?org/?10.?1109/?CVPR5?2729.?2023.?02307 |
| [10] | Iwasawa Y , Matsuo Y (2021) Test-time classifier adjustment module for model-agnostic domain generalization. In: Proceedings of the 35th International Conference on Neural Information Processing Systems (NIPS '21). Curran Associates Inc., Red Hook, NY, pp 2427-2440 |
| [11] | You F , Li J , Zhao Z (2021) Test-time batch statistics calibration for covariate shift. https://?doi.?org/?10.?48550/?arXiv.?2110.?04065 |
| [12] | Yang H , Chen C , Jiang M , Liu Q , Cao J , Heng PA et al (2022) DLTTA: dynamic learning rate for test-time adaptation on cross-domain medical images. IEEE Trans Med Imaging 41(12): 3575-3586. https://?doi.?org/?10.?1109/?TMI.?2022.?31915?35 |
| [13] | Niu S , Wu J , Zhang Y , Chen Y , Zheng S , Zhao P et al (2023) Efficient test-time model adaptation without forgetting. In: Proceedings of the 39th International Conference on Machine Learning. pp 16888-16905 |
| [14] | Niu S , Wu J , Zhang Y , Wen Z , Chen Y , Zhao P et al (2023) Towards stable test-time adaptation in dynamic wild world. https://?doi.?org/?10.?48550/?arXiv.?2302.?12400 |
| [15] | Nado Z , Padhy S , Sculley D , D’Amour A , Lakshminarayanan B , Snoek J (2021) Evaluating prediction-time batch normalization for robustness under covariate shift. https://?doi.?org/?10.?48550/?arXiv.?2203.?13591 |
| [16] | Saikia T , Schmid C , Brox T (2021) Improving robustness against common corruptions with frequency biased models. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, Montreal, pp 10191-10200. https://?doi.?org/?10.?1109/?ICCV4?8922.?2021.?01005 |
| [17] | Hendrycks D , Mu N , Cubuk ED , Zoph B , Gilmer J , Lakshminarayanan B (2020) AugMix: a simple data processing method to improve robustness and uncertainty. https://?doi.?org/?10.?48550/?arXiv.?1912.?02781 |
| [18] | Hu X , Uzunbas G , Chen S , Wang R , Shah A , Nevatia R et al (2021) MixNorm: test-time adaptation through online normalization estimation. https://?doi.?org/?10.?48550/?arXiv.?2110.?11478 |
| [19] | Lim H , Kim B , Choo J , Choi S (2023) TTN: a domain-shift aware batch normalization in test-time adaptation. https://?doi.?org/?10.?48550/?arXiv.?2302.?05155 |
| [20] | Zhao H , Liu Y , Alahi A , Lin T (2023) On pitfalls of test-time adaptation. In: Proceedings of the 40th International Conference on Machine Learning (ICML '23), Vol. 202. JMLR.org, pp 42058-42080. https://?doi.?org/?10.?48550/?arXiv.?2306.?03536 |
| [21] | He K , Zhang X , Ren S , Sun J (2015) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, pp 770-778. https://?doi.?org/?10.?48550/?arXiv.?1512.?03385 |
/
| 〈 |
|
〉 |