Skip to main content
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arXiv logo
Cornell University Logo

Distributed, Parallel, and Cluster Computing

Authors and titles for recent submissions

See today's new changes

Total of 64 entries : 1-50 51-64
Showing up to 50 entries per page: fewer | more | all

Tue, 29 Apr 2025 (showing 18 of 18 entries )

[1] arXiv:2504.19925 [pdf, html, other]
Title: Accelerating Mixture-of-Experts Training with Adaptive Expert Replication
Athinagoras Skiadopoulos, Mark Zhao, Swapnil Gandhi, Thomas Norrie, Shrijeet Mukherjee, Christos Kozyrakis
Comments: Preprint. Under review
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[2] arXiv:2504.19519 [pdf, html, other]
Title: FlashOverlap: A Lightweight Design for Efficiently Overlapping Communication and Computation
Ke Hong, Xiuhong Li, Minxu Liu, Qiuli Mao, Tianqi Wu, Zixiao Huang, Lufang Chen, Zhong Wang, Yichong Zhang, Zhenhua Zhu, Guohao Dai, Yu Wang
Comments: 17 pages, 11 figures, 4 tables
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computation and Language (cs.CL); Machine Learning (cs.LG)
[3] arXiv:2504.19516 [pdf, html, other]
Title: Bullet: Boosting GPU Utilization for LLM Serving via Dynamic Spatial-Temporal Orchestration
Zejia Lin, Hongxin Xu, Guanyi Chen, Xianwei Zhang, Yutong Lu
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[4] arXiv:2504.19495 [pdf, other]
Title: Adjusted Objects: An Efficient and Principled Approach to Scalable Programming (Extended Version)
Boubacar Kane, Pierre Sutra
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[5] arXiv:2504.19442 [pdf, html, other]
Title: Triton-distributed: Programming Overlapping Kernels on Distributed AI Systems with the Triton Compiler
Size Zheng, Wenlei Bao, Qi Hou, Xuegui Zheng, Jin Fang, Chenhui Huang, Tianqi Li, Haojie Duanmu, Renze Chen, Ruifan Xu, Yifan Guo, Ningxin Zheng, Ziheng Jiang, Xinyi Di, Dongyang Wang, Jianxi Ye, Haibin Lin, Li-Wen Chang, Liqiang Lu, Yun Liang, Jidong Zhai, Xin Liu
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[6] arXiv:2504.19365 [pdf, other]
Title: AGILE: Lightweight and Efficient Asynchronous GPU-SSD Integration
Zhuoping Yang, Jinming Zhuang, Xingzhen Chen, Alex K. Jones, Peipei Zhou
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[7] arXiv:2504.19283 [pdf, html, other]
Title: Efficient Serverless Cold Start: Reducing Library Loading Overhead by Profile-guided Optimization
Syed Salauddin Mohammad Tariq, Ali Al Zein, Soumya Sripad Vaidya, Arati Khanolkar, Zheng Song, Probir Roy
Comments: Accepted for publication at the 45th IEEE International Conference on Distributed Computing Systems (ICDCS 2025)
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)
[8] arXiv:2504.19232 [pdf, html, other]
Title: Adaptra: Straggler-Resilient Hybrid-Parallel Training with Pipeline Adaptation
Tianyuan Wu, Lunxi Cao, Hanfeng Lu, Xiaoxiao Jiang, Yinghao Yu, Siran Yang, Guodong Yang, Jiamang Wang, Lin Qu, Liping Zhang, Wei Wang
Comments: 17 pages, 21 figures
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[9] arXiv:2504.19048 [pdf, html, other]
Title: GPU Acceleration of Monte Carlo Tallies on Unstructured Meshes in OpenMC with PUMI-Tally
Fuad Hasan, Cameron W. Smith, Mark S. Shephard, R. Michael Churchill, George J. Wilkie, Paul K. Romano, Patrick C. Shriwise, Jacob S. Merson
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Computational Physics (physics.comp-ph)
[10] arXiv:2504.18916 [pdf, html, other]
Title: UnifyFL: Enabling Decentralized Cross-Silo Federated Learning
Sarang S, Druva Dhakshinamoorthy, Aditya Shiva Sharma, Yuvraj Singh Bhadauria, Siddharth Chaitra Vivek, Arihant Bansal, Arnab K. Paul
Comments: 12 pages, 7 figures, 7 tables. Accepted at the 26th ACM/IFIP International Middleware Conference (MIDDLEWARE 2025)
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)
[11] arXiv:2504.18658 [pdf, html, other]
Title: The Big Send-off: High Performance Collectives on GPU-based Supercomputers
Siddharth Singh, Mahua Singh, Abhinav Bhatele
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
[12] arXiv:2504.18649 [pdf, other]
Title: Raptr: Prefix Consensus for Robust High-Performance BFT
Andrei Tonkikh, Balaji Arun, Zhuolun Xiang, Zekun Li, Alexander Spiegelman
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[13] arXiv:2504.19867 (cross-list from cs.CL) [pdf, html, other]
Title: semi-PD: Towards Efficient LLM Serving via Phase-Wise Disaggregated Computation and Unified Storage
Ke Hong, Lufang Chen, Zhong Wang, Xiuhong Li, Qiuli Mao, Jianping Ma, Chao Xiong, Guanyu Wu, Buhe Han, Guohao Dai, Yun Liang, Yu Wang
Comments: 18 pages, 16 figures
Subjects: Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[14] arXiv:2504.19720 (cross-list from cs.CL) [pdf, html, other]
Title: Taming the Titans: A Survey of Efficient LLM Inference Serving
Ranran Zhen, Juntao Li, Yixin Ji, Zhenlin Yang, Tong Liu, Qingrong Xia, Xinyu Duan, Zhefeng Wang, Baoxing Huai, Min Zhang
Comments: work in progress;11 pages of main paper with 7 main figures, overall 20 pages
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[15] arXiv:2504.19103 (cross-list from cs.LG) [pdf, html, other]
Title: Harmonizing Generalization and Personalization in Ring-topology Decentralized Federated Learning
Shunxin Guo, Jiaqi Lv, Xin Geng
Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)
[16] arXiv:2504.19064 (cross-list from cs.CR) [pdf, html, other]
Title: Security Vulnerabilities in Quantum Cloud Systems: A Survey on Emerging Threats
Justin Coupel, Tasnuva Farheen
Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)
[17] arXiv:2504.18966 (cross-list from cs.CR) [pdf, other]
Title: Redefining Hybrid Blockchains: A Balanced Architecture
Syed Ibrahim Omer
Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)
[18] arXiv:2504.18570 (cross-list from cs.CR) [pdf, html, other]
Title: Residual-Evasive Attacks on ADMM in Distributed Optimization
Sabrina Bruckmeier, Huadong Mo, James Qin
Comments: 10 pages, 12 figures, 2 tables
Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Optimization and Control (math.OC)

Mon, 28 Apr 2025 (showing 4 of 4 entries )

[19] arXiv:2504.18211 [pdf, html, other]
Title: Dynamic Memory Management on GPUs with SYCL
Russell K. Standish
Comments: 9 pages, 12 figures
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[20] arXiv:2504.18154 [pdf, html, other]
Title: EcoServe: Enabling Cost-effective LLM Serving with Proactive Intra- and Inter-Instance Orchestration
Jiangsu Du, Hongbin Zhang, Taosheng Wei, Zhenyi Zheng, Kaiyi Wu, Zhiguang Chen, Yutong Lu
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[21] arXiv:2504.18038 (cross-list from cs.IT) [pdf, html, other]
Title: Optimal Secure Coded Distributed Computation over all Fields
Pedro Soto
Subjects: Information Theory (cs.IT); Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS); Symbolic Computation (cs.SC); Algebraic Geometry (math.AG)
[22] arXiv:2504.17818 (cross-list from cs.NI) [pdf, html, other]
Title: Fast Multichannel Topology Discovery in Cognitive Radio Networks
Yung-Li Wang, Yiwei Liu, Cheng-Shang Chang
Comments: 5 figures
Subjects: Networking and Internet Architecture (cs.NI); Distributed, Parallel, and Cluster Computing (cs.DC)

Fri, 25 Apr 2025 (showing 11 of 11 entries )

[23] arXiv:2504.17675 [pdf, other]
Title: Optimized Cloud Resource Allocation Using Genetic Algorithms for Energy Efficiency and QoS Assurance
Caroline Panggabean, Devaraj Verma C, Bhagyashree Gogoi, Ranju Limbu, Rhythm Sarker
Comments: 7 pages, 5 figures, accepted for publication (not yet published)
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)
[24] arXiv:2504.17672 [pdf, html, other]
Title: Cross-region Model Training with Communication-Computation Overlapping and Delay Compensation
Ying Zhu, Yang Xu, Hongli Xu, Yunming Liao, Zhiwei Yao, Liusheng Huang
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[25] arXiv:2504.17598 [pdf, html, other]
Title: TSUE: A Two-Stage Data Update Method for an Erasure Coded Cluster File System
Zheng Wei, Jing Xing, Yida Gu, Wenjing Huang, Dong Dai, Guangming Tan, Dingwen Tao
Comments: 14 pages, 8 figures, accepted by ACM HPDC 2025
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[26] arXiv:2504.17583 [pdf, html, other]
Title: Shared Randomness in Locally Checkable Problems: The Role of Computational Assumptions
Adar Hadad, Moni Naor
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[27] arXiv:2504.17338 [pdf, html, other]
Title: Dynamic Approximate Maximum Matching in the Distributed Vertex Partition Model
Peter Robinson, Xianbin Zhu
Comments: 22 pages
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Data Structures and Algorithms (cs.DS)
[28] arXiv:2504.17097 [pdf, html, other]
Title: Parallelizing the Approximate Minimum Degree Ordering Algorithm: Strategies and Evaluation
Yen-Hsiang Chang, Aydın Buluç, James Demmel
Comments: 11 pages, 7 figures, 5 tables
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Discrete Mathematics (cs.DM); Data Structures and Algorithms (cs.DS)
[29] arXiv:2504.17096 [pdf, html, other]
Title: Sailor: Automating Distributed Training over Dynamic, Heterogeneous, and Geo-distributed Clusters
Foteini Strati, Zhendong Zhang, George Manos, Ixeia Sánchez Périz, Qinghao Hu, Tiancheng Chen, Berk Buzcu, Song Han, Pamela Delgado, Ana Klimovic
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[30] arXiv:2504.17520 (cross-list from cs.LG) [pdf, html, other]
Title: Communication-Efficient Personalized Distributed Learning with Data and Node Heterogeneity
Zhuojun Tian, Zhaoyang Zhang, Yiwei Li, Mehdi Bennis
Comments: Accepcted by TCCN
Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Multiagent Systems (cs.MA)
[31] arXiv:2504.17471 (cross-list from cs.LG) [pdf, html, other]
Title: GRANITE : a Byzantine-Resilient Dynamic Gossip Learning Framework
Yacine Belal, Mohamed Maouche, Sonia Ben Mokhtar, Anthony Simonet-Boulogne
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC)
[32] arXiv:2504.17448 (cross-list from cs.LG) [pdf, html, other]
Title: CHASe: Client Heterogeneity-Aware Data Selection for Effective Federated Active Learning
Jun Zhang, Jue Wang, Huan Li, Zhongle Xie, Ke Chen, Lidan Shou
Comments: Accepted by TKDE 2025
Subjects: Machine Learning (cs.LG); Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC)
[33] arXiv:2504.17194 (cross-list from cs.CR) [pdf, other]
Title: Developing a Blockchain-Based Secure Digital Contents Distribution System
Syed Mohiuddin Qadri, Sangwhan Cha
Comments: 4 pages, 5 figures
Subjects: Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)

Thu, 24 Apr 2025 (showing 12 of 12 entries )

[34] arXiv:2504.16792 [pdf, html, other]
Title: Preemption Aware Task Scheduling for Priority and Deadline Constrained DNN Inference Task Offloading in Homogeneous Mobile-Edge Networks
Jamie Cotter, Ignacio Castineiras, Donna O'Shea, Victor Cionca
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[35] arXiv:2504.16732 [pdf, html, other]
Title: Simplified Swarm Learning Framework for Robust and Scalable Diagnostic Services in Cancer Histopathology
Yanjie Wu, Yuhao Ji, Saiho Lee, Juniad Akram, Ali Braytee, Ali Anaissi
Comments: 8 pages, 4 figures, 2025 International Conference on Computational Science
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)
[36] arXiv:2504.16552 [pdf, html, other]
Title: DTVM: Revolutionizing Smart Contract Execution with Determinism and Compatibility
Wei Zhou, Changzheng Wei, Ying Yan, Wei Tang, Zhihao Chen, Xiong Xu, Xuebing Huang, Wengang Chen, Jie Zhang, Yang Chen, Xiaofu Zheng, Hanghang Wu, Shenglong Chen, Ermei Wang, Xiangfei Chen, Yang Yu, Meng Wu, Tao Zhu, Liwei Yuan, Feng Yu, Alex Zhang, Wei Wang, Ji Luo, Zhengyu He, Wenbiao Zhao
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[37] arXiv:2504.16529 [pdf, html, other]
Title: 6G EdgeAI: Performance Evaluation and Analysis
Chien-Sheng Yang, Yu-Jen Ku, Yuan-Yao Lou, Nathan Tenny, Alex C.-C. Hsu
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[38] arXiv:2504.16357 [pdf, html, other]
Title: DP2FL: Dual Prompt Personalized Federated Learning in Foundation Models
Ying Chang, Xiaohu Shi, Xiaohui Zhao, Zhaohuang Chen, Deyin Ma
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
[39] arXiv:2504.16344 [pdf, html, other]
Title: Real-time Bayesian inference at extreme scale: A digital twin for tsunami early warning applied to the Cascadia subduction zone
Stefan Henneking, Sreeram Venkat, Veselin Dobrev, John Camier, Tzanio Kolev, Milinda Fernando, Alice-Agnes Gabriel, Omar Ghattas
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Numerical Analysis (math.NA); Geophysics (physics.geo-ph)
[40] arXiv:2504.16324 [pdf, html, other]
Title: The Dawn of Disaggregation and the Coherence Conundrum: A Call for Federated Coherence
Jaewan Hong, Marcos K. Aguilera, Emmanuel Amaro, Vincent Liu, Aurojit Panda, Ion Stoica
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Hardware Architecture (cs.AR)
[41] arXiv:2504.16267 [pdf, html, other]
Title: Two-Fold Byzantine Fault Tolerance Algorithm: Byzantine Consensus in Blockchain
Mohammad R. Shakournia, Pooya Jamshidi, Hamid Reza Faragardi, Nasser Yazdani
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Networking and Internet Architecture (cs.NI)
[42] arXiv:2504.16227 [pdf, html, other]
Title: Towards a Distributed Federated Learning Aggregation Placement using Particle Swarm Intelligence
Amir Ali-Pour, Sadra Bekrani, Laya Samizadeh, Julien Gascon-Samson
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Networking and Internet Architecture (cs.NI)
[43] arXiv:2504.16438 (cross-list from cs.LG) [pdf, html, other]
Title: Private Federated Learning using Preference-Optimized Synthetic Data
Charlie Hou, Mei-Yu Wang, Yige Zhu, Daniel Lazar, Giulia Fanti
Comments: Spotlight presentation at SynthData Workshop ICLR25
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Distributed, Parallel, and Cluster Computing (cs.DC)
[44] arXiv:2504.16382 (cross-list from cs.DS) [pdf, html, other]
Title: Fully Scalable MPC Algorithms for Euclidean k-Center
Artur Czumaj, Guichen Gao, Mohsen Ghaffari, Shaofeng H.-C. Jiang
Subjects: Data Structures and Algorithms (cs.DS); Distributed, Parallel, and Cluster Computing (cs.DC)
[45] arXiv:2504.16112 (cross-list from cs.AR) [pdf, html, other]
Title: HPU: High-Bandwidth Processing Unit for Scalable, Cost-effective LLM Inference via GPU Co-processing
Myunghyun Rhee, Joonseop Sim, Taeyoung Ahn, Seungyong Lee, Daegun Yoon, Euiseok Kim, Kyoung Park, Youngpyo Joo, Hosik Kim
Comments: 6 pages
Subjects: Hardware Architecture (cs.AR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

Wed, 23 Apr 2025 (showing first 5 of 19 entries )

[46] arXiv:2504.15986 [pdf, html, other]
Title: Charting the Uncharted: The Landscape of Monero Peer-to-Peer Network
Yu Gao, Matija Piškorec, Yu Zhang, Nicolò Vallarano, Claudio J. Tessone
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[47] arXiv:2504.15856 [pdf, html, other]
Title: FailLite: Failure-Resilient Model Serving for Resource-Constrained Edge Environments
Li Wu, Walid A. Hanafy, Tarek Abdelzaher, David Irwin, Jesse Milzman, Prashant Shenoy
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[48] arXiv:2504.15724 [pdf, html, other]
Title: Collaborative Split Federated Learning with Parallel Training and Aggregation
Yiannis Papageorgiou, Yannis Thomas, Alexios Filippakopoulos, Ramin Khalili, Iordanis Koutsopoulos
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI)
[49] arXiv:2504.15720 [pdf, html, other]
Title: SeaLLM: Service-Aware and Latency-Optimized Resource Sharing for Large Language Model Inference
Yihao Zhao, Jiadun Chen, Peng Sun, Lei Li, Xuanzhe Liu, Xin Jin
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC)
[50] arXiv:2504.15637 [pdf, other]
Title: DR.FIX: Automatically Fixing Data Races at Industry Scale
Farnaz Behrang, Zhizhou Zhang, Georgian-Vlad Saioc, Peng Liu, Milind Chabbi
Comments: To appear in PLDI 2025
Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Programming Languages (cs.PL); Software Engineering (cs.SE)
Total of 64 entries : 1-50 51-64
Showing up to 50 entries per page: fewer | more | all