Skip to main content

Distributed, Parallel, and Cluster Computing

Authors and titles for recent submissions

See today's new changes

Total of 138 entries : 1-50 51-100 101-138
Showing up to 50 entries per page: fewer | more | all

Fri, 16 Oct 2026 (showing 16 of 16 entries )

[1] arXiv:2610.22230 [pdf, html, other]
Title: Architecting for Hardware Diversity: Meta's End-to-End Co-Design for High-Performance AI Training on AMD GPUs
Haoyu Zhang, Arshad Rahman, Adnan Aziz, Ajith Prabhudev, Amin Farmahini, Ben Rhoads, Benson Ma, Brian Shi, Cen Zhao, CK Luk, Dingming Wu, Emad El-Haraty, Eric Chen, Frank Li, Gary Huang, Gefei Zuo, Haoran Zhang, Hiwot Kassa, Hongyi Zeng, Jack Taylor, Jeremy Hadidjojo, John Donati, Jonathan Sheffield, Julio Machado Silva, Karthik Ganesan, Kent Russell, KR Kishore, Lei Tian, Liu Ke, Muhammad Osama, Peng Chen, Rakesh Hemnani, Ryan Swann, Saleel Kudchadker, Shankar Yanamandram, Shobhit Kanaujia, Shucai Xiao, Srinath Bayareddy, Srinivas Vaidyanathan, Sudharssun Subramanian, Supadchaya Puangpontip, Taylor Robie, Tianhao Huang, Tyler Hart, Viswesh Sankaran, Weijun Jiang, Wenkai Du, Xiaodong Wang, Xiaohu Guo, Yao Rong, Yinbin Ma, Yue Dong, Yuzhen Huang, Yvonne Liu, Zhan Shu, Dan Rabinovitsj, Ajit Mathews, Chunqiang Tang
Comments: 16 pages, 21 figures, 6 tables. To appear in the 59th IEEE/ACM International Symposium on Microarchitecture (MICRO 2026)
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Hardware Architecture (cs.AR); Machine Learning (cs.LG)
[2] arXiv:2610.22172 [pdf, html, other]
Title: Efficient KV Cache Migration for Geo-Distributed LLM Inference in Collaborative Edge Computing
Mingjin Zhang, Jiannong Cao, Tao Wu, Xiangchun Chen, Ne Wang
Comments: Accepted by ICDCS 2026
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[3] arXiv:2610.22035 [pdf, html, other]
Title: ETH: Data-Balanced Heterogeneous Pipeline Parallelism for Training Large Models
Mianjie Yu, Zhongmin Zhao, Zizhao Mo, Jianxiong Liao, Wenxuan Li, Yulin Qiao, Huanle Xu, Wenquan Yang, Yongqiang Yang, Zeren Li, Ruifeng Tang, Chengzhong Xu
Comments: 19 pages, 14 figures. Accepted at USENIX NSDI 2027
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[4] arXiv:2610.22015 [pdf, html, other]
Title: Resource-aware Sub-network Allocation for Heterogeneous Decentralized Learning
Zhuojun Tian, Ming Xiao, Mikael Skoglund
Comments: Submitted to TCCN
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[5] arXiv:2610.21815 [pdf, html, other]
Title: Exact Makespan Bounds and the GPipe Homogeneity Bias for Heterogeneous LLM Inference Pipelines
Zhu Wenbo
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[6] arXiv:2610.21500 [pdf, html, other]
Title: When the KV Cache Is Slower Than the GPU: Scaling Remote KV Tiers for Context-Parallel Prefill
Muhammad Ibrahim
Comments: 9 pages, 8 figures, 3 tables
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[7] arXiv:2610.21162 [pdf, html, other]
Title: Coordination-Free Workload Regularization for Variable-Cost Distributed Training
Tao Huang, Chen Zhu, Antonio Alonso, Daming Li, Adarsh Goura, Jaideep Ray, Yitong Zhou
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[8] arXiv:2610.21069 [pdf, html, other]
Title: Probabilistic Optical-Layer Surrogate for Risk-Aware Control-Plane Decision Making
Venkat Sai Suman Lamba Karanam
Comments: 20 pages, 6 figures, 11 tables. Accepted at ACM CoNEXT 2026. Published in Proc. ACM Netw. 4, CoNEXT4, Article 44 (December 2026)
Journal-ref: Proc. ACM Netw. 4, CoNEXT4, Article 44 (December 2026)
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[9] arXiv:2610.20981 [pdf, html, other]
Title: Cyclotron: A Recurrence Language for Expressing Interprocessor Communication
Shiv Sundram, Akhilesh Balasingam, Nathan Zhang, Kunle Olukotun, Fredrik Kjolstad
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[10] arXiv:2610.21832 (cross-list from cs.LG) [pdf, html, other]
Title: Local Epochs as Optimal Stopping: Theory and Evidence in Federated Learning
Ke Xiao, Qiyuan Wang, Christos Anagnostopoulos
Comments: 27 pages, 7 figures, 18 tables. Includes appendices
Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)
[11] arXiv:2610.21640 (cross-list from cs.LG) [pdf, html, other]
Title: ReFlow: Replay-Driven Decoupling for Efficient RL Post-Training
Yukun Tian, Junwei Su, Haofeng Xu, Lansong Diao, Zhengping Qian, Weibo Zhao, Wenchao Zhou, Ruiting Zhou, Chuan Wu
Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)
[12] arXiv:2610.21457 (cross-list from cs.CR) [pdf, html, other]
Title: Benchmarking Post-Quantum Key Encapsulation in S3-Compatible Object Storage under Client Concurrency
Revanth Reddy Lingala, K. Gangadhara Rao, Padigela Srujan, Saarthak Manocha, Vainavi Venkat
Comments: 21 pages, 4 figures, 23 tables. Code and per-run data: this https URL
Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)
[13] arXiv:2610.21436 (cross-list from cs.CL) [pdf, html, other]
Title: HyCo: Hybrid Drafting for Cost-Efficient Mobile-Cloud Speculative Decoding
Hanbin Bae, Heejin Choi, Joohyung Lee, Byoung Jin Choi, Sangjun Park, Hoon-Young Cho
Comments: Under review at ACL Rolling Review (October 2026)
Subjects: Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[14] arXiv:2610.21264 (cross-list from cs.DB) [pdf, html, other]
Title: AdaBool: Sparse Boolean Matrix Processing with Adaptive Data Representation
Xiangrui Yang, Yifan Lei, Jiawei Yang, Yekang Zhan, Yuxin Zheng, Lei Mao, Zhaoren Wu, Yibo Huang, Yiming Qiu
Comments: Accepted to ACM SIGMOD 2027 (Proceedings of the ACM on Management of Data). 16 pages, 21 figures, 7 tables
Subjects: Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC)
[15] arXiv:2610.21096 (cross-list from cs.AR) [pdf, other]
Title: Helix: A Unified Programmable Accelerator for Diverse Krylov Subspace Solvers
Wei Chen, Yizhi Yuan, Linghao Song
Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)
[16] arXiv:2610.20616 (cross-list from cs.SE) [pdf, other]
Title: Harnessing MPI mutations for AI error detection
Asia Auville (STORM, TADAAM), Tim Jammer (TU Darmstadt), Eric Petit (LI-PaRAD), Pablo de Oliveira Castro (LI-PaRAD, UVSQ), Emmanuelle Saillard (STORM), Mihail Popov (TADAAM)
Journal-ref: ICS 2026 - ACM International Conference on Supercomputing, Jul 2026, Belfast, United Kingdom. pp.1000-1013
Subjects: Software Engineering (cs.SE); Distributed, Parallel, and Cluster Computing (cs.DC)

Thu, 15 Oct 2026 (showing 15 of 15 entries )

[17] arXiv:2610.20354 [pdf, html, other]
Title: Understanding NVIDIA Grace-Blackwell Unified Memory Through Placement-Controlled Microbenchmarks
Nathan Graddon, Aaron Jarmusch, Sunita Chandrasekaran
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[18] arXiv:2610.20029 [pdf, html, other]
Title: TrimSO(2): Fast and Memory-Efficient Training of Equivariant Interatomic Potentials
Chen Wang, Yuanchang Zhou, Guangming Tan, Mingzhen Li, Weile Jia
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[19] arXiv:2610.19822 [pdf, html, other]
Title: JointServe: Serving Multi-Model Agents on Memory-Constrained GPUs
Daijin Hu
Comments: 18 pages, 12 figures, 1 table
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[20] arXiv:2610.19819 [pdf, html, other]
Title: The Cost of Context: Profiling the Energy Footprint of Input Tokens in Large Language Models
Boris Ruf, Marcin Detyniecki
Comments: Accepted at HotCarbon'26, the 5th Workshop on Sustainable Computer Systems; to appear in ACM SIGENERGY Energy Informatics Review, Vol. 6, Issue 2
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[21] arXiv:2610.19405 [pdf, html, other]
Title: Scaling LLM Inference via Parallelism: Throughput-Latency Trade-off
Javad Mirzaei, Jeebak Mitra
Comments: 15 pages, 7 figures
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Performance (cs.PF)
[22] arXiv:2610.19308 [pdf, html, other]
Title: Parallel Sparse Outputs for Tensor Compilers
Adrian Gushin, Pau Sum, Willow Ahrens
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[23] arXiv:2610.20567 (cross-list from cs.NI) [pdf, html, other]
Title: Prioritizing Microservice Requests via Retries
Ofek Lavi, Jhonatan Tavori, Hanoch Levy, Anat Bremler-Barr
Subjects: Networking and Internet Architecture (cs.NI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)
[24] arXiv:2610.19801 (cross-list from cs.CL) [pdf, html, other]
Title: Delta Tokenizer: Reference-Identical Tokenization of Session Deltas and Segment-Parallelism for Long Prompts on Multicore CPUs
Zhenyu Zhang, Zhichao Cao
Comments: 42 pages (16-page main text, references, and supplementary material), 14 figures, 35 tables. The incremental tokenization path and the fast encoder are open source in toktier at this https URL. The chunk-parallel path, the CPU pool scheduler, and the SGLang adapter will be released in the same repository
Subjects: Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)
[25] arXiv:2610.19778 (cross-list from physics.optics) [pdf, other]
Title: Computational compressive imaging reconstruction with a simulated-annealing-based Ising solver
Ze Zheng, Xiaoyan Wu, Hang Xu, Jingzheng Huang, Tailong Xiao, Guihua Zeng
Comments: 15 pages, 6 figures
Subjects: Optics (physics.optics); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Mathematical Physics (math-ph); Applied Physics (physics.app-ph)
[26] arXiv:2610.19710 (cross-list from cs.DS) [pdf, html, other]
Title: Dynamic 3-Coloring of Bipartite Graphs with Optimal Locality
Yann Bourreau, Filippo Casagrande, Tim Göttlicher, Ananth Narayanan Karunattillam
Comments: 18 pages, 2 figures
Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)
[27] arXiv:2610.19489 (cross-list from cs.PF) [pdf, html, other]
Title: How the Dirty Set Moves: Characterizing Schedule Reuse in Incremental Sparse Matrix Multiplication
Hunter Horne (HorneSci), Eric Spencer (Loyola University Chicago, HorneSci), Alex Henningfield (HorneSci), Arslan Bisharat (Loyola University Chicago)
Comments: 12 pages, 7 figures, 8 tables
Subjects: Performance (cs.PF); Distributed, Parallel, and Cluster Computing (cs.DC); Mathematical Software (cs.MS)
[28] arXiv:2610.19423 (cross-list from cs.AI) [pdf, html, other]
Title: Beyond the Trial-and-Error Loop: Hybrid Projection and Automated Tuning for Distributed Training
Anshu Raina, Peyman Razaghi, Yuankai Chen, Cheng Yao, Yao Fu, Vidushi Goyal, Devang Patel, Wen Xie, Zhenyu Gu, Emad Barsoum
Comments: Accepted at NeurIPS 2026. 22 pages, 8 figures, 25 tables
Subjects: Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)
[29] arXiv:2610.19077 (cross-list from quant-ph) [pdf, html, other]
Title: Federated Unlearning of Quantum Data via Classical Shadows
Zihao Ding, Jun Huang, Cong-cong Xing
Subjects: Quantum Physics (quant-ph); Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)
[30] arXiv:2610.19072 (cross-list from cs.NI) [pdf, html, other]
Title: Tracing Knowledge Lineage for Federated Unlearning under Mutual Distillation
Zihao Ding, Jun Huang, Guodong Wang
Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)
[31] arXiv:2610.18925 (cross-list from cs.AR) [pdf, html, other]
Title: CacheSmith: Accurate RAG Serving under Latency SLOs with Adaptive KV Reuse
Xinyue Ma, Damin Lee, Aashaka Shah, Myeongjae Jeon
Subjects: Hardware Architecture (cs.AR); Distributed, Parallel, and Cluster Computing (cs.DC)

Wed, 14 Oct 2026 (showing first 19 of 76 entries )

[32] arXiv:2610.18772 [pdf, html, other]
Title: A Distributed Energy Relay Framework for Sustainable Drone Missions
I-Ling Yen, Farokh Bastani, Akeem Mohammed, Agastya Bose
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[33] arXiv:2610.18565 [pdf, html, other]
Title: Orrery: Modeling and Simulation of GPU-direct MPI Communication with SimGrid
Ahmad Moh'd Saleh A. Belbeisi, Amir Raoofy, Josef Weidendorfer, Majid Salimi Beni
Comments: Accepted as a short paper at the PMBS 2026 workshop (held in conjunction with SC26)
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)
[34] arXiv:2610.18557 [pdf, html, other]
Title: Revisiting Cauchy-Schwarz Norm Bounds for SDC Detection in LLM Inference
Anton Altenbernd, Dylan Everingham, Philipp Wiesner, Odej Kao
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[35] arXiv:2610.18532 [pdf, html, other]
Title: Tremulant: Latency in Serverless Platforms beyond the 99th Percentile
Linus Gustafsson, Trever Schirmer, David Bermbach
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[36] arXiv:2610.18451 [pdf, html, other]
Title: FastEEP: Fast Intra-Instance Elastic Scaling for Expert-Parallel MoE Serving
Yunfei Feng, Jingkai He, Shiqi Liu, Cheng Zhang, Dong Du, Erhu Feng
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[37] arXiv:2610.18393 [pdf, html, other]
Title: LunaTP: Enabling Efficient and Scalable Tensor Product for Equivariant MLIPs
Yuanchang Zhou, Mingzhen Li, Chen Wang, Xiangyu Zhang, Guangming Tan, Weile Jia
Comments: 26 pages, 11 figures
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[38] arXiv:2610.18009 [pdf, html, other]
Title: A Distributed View from a Single GPU: RankLens for Distributed Training
Yufan Wang, Yihao Zhang, Yi Liu
Comments: 12pages, 9 figures
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[39] arXiv:2610.17795 [pdf, html, other]
Title: Quota-Based Aging for Prediction-Guided Scheduling in LLM Serving
Hanzhi Zhang, Anxuan Che, Hang Qi, Qiyue Li, Jingjin Wu
Comments: 8 pages, 10 figures. Accepted for publication at the 45th IEEE International Performance, Computing, and Communications Conference (IPCCC 2026), Austin, TX, November 2026
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[40] arXiv:2610.17677 [pdf, html, other]
Title: A Minimum Exact Disjunctive Basis for Two-Robot Solvability Profiles
Tsukasa Ninomiya, Shota Naito, Naoki Kitamura, Yuichi Sudo, Koichi Wada
Comments: 100 pages, 2 figures, 9 tables
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Robotics (cs.RO); Combinatorics (math.CO)
[41] arXiv:2610.17551 [pdf, html, other]
Title: Capacity over TFLOPS: Memory-Centric Deployment of Large Clinical Language Models on Consumer CPUs
Eli Yune, Umer Majeed, Mahesh Balan
Comments: 6 pages, 4 figures. Accepted to the 2026 IEEE 15th International Conference on Consumer Electronics - Berlin (ICCE-Berlin). (c) 2026 IEEE. Code: this https URL
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[42] arXiv:2610.17546 [pdf, html, other]
Title: FLAI Protocol: Decentralized Federated Learning with On-Chain Rewards and sPEG-Based Contribution Scoring
Eli Yune, Mahesh Balan
Comments: 6 pages, 2 figures. Published in Proc. 2026 IEEE International Conference on Consumer Electronics (ICCE). (c) 2026 IEEE
Journal-ref: Proc. 2026 IEEE International Conference on Consumer Electronics (ICCE)
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[43] arXiv:2610.17528 [pdf, html, other]
Title: ATTUNE: Agentic Throughput Tuning for LLM Training
Leo Fan, Hongyang Wang, Wenbo Chen, Jingguo Liu, Xian Li, Xuan Wang, Ruochen Wen, Yiming Yan, Hao Wu, Zheshen Wang, Benoit Dumoulin
Comments: "21 pages, 2 figures, 14 tables
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[44] arXiv:2610.17321 [pdf, html, other]
Title: GPU Goldmines: Tunable WebGPU Kernels for Edge LLM Inference
Rithik Sharma, Reese Levine, Zheyuan Chen, Ananthajit Srikanth, Yanwen Xu, Tyler Sorensen
Comments: 11 pages, 5 figures, 5 tables
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Performance (cs.PF)
[45] arXiv:2610.17035 [pdf, html, other]
Title: FlashT2S: GPU-Accelerated Tensor-to-Spike Conversion Operators for Heterogeneous Neuromorphic LLM Backends
Rongyuan Guo, Haotian Wang, Yufeng Zhang, Wangdong Yang, Kenli Li
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[46] arXiv:2610.16987 [pdf, html, other]
Title: MODAIC: Coordinated Asynchrony for Decentralized Multimodal Learning
Yanhang Shi, Xiaoyu Wang, Houwei Cao, Jian Li, Yong Liu
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)
[47] arXiv:2610.16935 [pdf, html, other]
Title: Beyond the Boundary: Optimal Grid Dispersion by Spread, Reverse, and Collect
Manish Kumar, Anisur Rahaman Molla, Debasish Pattanayak, Subhajit Pramanick
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[48] arXiv:2610.16787 [pdf, html, other]
Title: Improved Massively Parallel Shortest Path Computation
Yi-Jun Chang, Shaun Quek
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)
[49] arXiv:2610.16691 [pdf, html, other]
Title: StageBreaker: Shifting Video RL Post-Training Scheduling from Stages down to Data Dependencies
Li Peng, Chenghuan Huang, Ziyang Ma, Jing Lyu, Xiang Chen, Jie Zhang
Comments: 16 pages, 16 figures
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[50] arXiv:2610.16592 [pdf, html, other]
Title: Prorsa: Unleashing the Potential of Prefill-Decode Disaggregation in Agentic Reinforcement Learning
Chiheng Lou, Xiangwei Deng, Bangjun Xiao, Xiaodong Ji, Yikai Zhao, Xin Jin, Hailin Zhang
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
Total of 138 entries : 1-50 51-100 101-138
Showing up to 50 entries per page: fewer | more | all