Darzin International Company Multidisciplinary Engineering Science Open 2 Serial Number 2 2025 01 01 TinyML on the Edge: Model Compression, On-Device Learning, and Energy–Latency Trade-Offs TinyML on the Edge: Model Compression, On-Device Learning, and Energy–Latency Trade-Offs 1 12 EN Journal Article 2024 10 21 <p>This review article aims to synthesize contemporary developments in Tiny Machine Learning (TinyML)—with emphasis on model compression, on-device learning, and energy–latency trade-offs—to establish an integrated understanding of how intelligent inference and adaptation can be achieved on highly resource-constrained edge devices. This study employed a qualitative systematic review design grounded in thematic analysis. Sixteen peer-reviewed articles published between 2019 and 2025 were selected from major scientific databases, including IEEE Xplore, ACM Digital Library, ScienceDirect, and SpringerLink, based on relevance to TinyML, model compression, and edge inference optimization. Data collection was exclusively literature-based, following theoretical saturation principles. All selected studies were imported into NVivo 14 for open, axial, and selective coding. Analytical procedures involved identifying recurring concepts and grouping them into higher-order themes through iterative interpretation. The reliability of coding was maintained via memo-keeping and cross-verification of emergent categories. Four major thematic categories emerged: (1) Model compression and optimization, encompassing pruning, quantization, distillation, and compiler-level acceleration; (2) On-device learning and adaptation, highlighting federated, meta-learning, and reinforcement learning techniques for autonomous edge model evolution; (3) Energy–latency trade-off management, focusing on multi-objective optimization frameworks, hardware–software co-design, and low-power accelerators; and (4) Application scenarios and benchmarking, demonstrating TinyML’s adoption in vision, audio, biomedical, and industrial IoT contexts supported by standardized metrics such as MLPerf Tiny. Collectively, these findings confirm that achieving sustainable edge intelligence requires a unified co-optimization of algorithmic, hardware, and runtime dimensions. TinyML represents a convergence of embedded engineering and artificial intelligence where compression, learning, and energy optimization interlock to enable autonomous, low-power, and responsive systems. Future research should advance adaptive, security-aware, and cross-domain frameworks to realize robust, scalable edge intelligence.</p> https://jmesopen.com/index.php/jmesopen/article/download/12/10